-- Logs begin at Tue 2022-05-10 15:57:26 UTC, end at Tue 2022-05-10 16:57:25 UTC. -- May 10 16:30:20.695948 dv-cinder-841302-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 16:30:20.705683 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 16:30:20 2022] *** May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: nodename: dv-cinder-841302-1-iscsi May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: machine: x86_64 May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: clock source: unix May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: pcre jit disabled May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: detected number of CPU cores: 4 May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: current working directory: / May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: detected binary path: /usr/bin/uwsgi-core May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: your processes number limit is 47680 May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: your memory page size is 4096 bytes May 10 16:30:20.706930 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: detected max file descriptor number: 2048 May 10 16:30:20.707634 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: lock engine: pthread robust mutexes May 10 16:30:20.707634 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: thunder lock: enabled May 10 16:30:20.707634 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 16:30:20.707634 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 16:30:20.752495 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: Python main interpreter initialized at 0x5614ec0e99c0 May 10 16:30:20.752495 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: python threads support enabled May 10 16:30:20.752495 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: your server socket listen backlog is limited to 100 connections May 10 16:30:20.752495 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: your mercy for graceful operations on workers is 90 seconds May 10 16:30:20.752858 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: mapped 403077 bytes (393 KB) for 2 cores May 10 16:30:20.752932 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: *** Operational MODE: preforking *** May 10 16:30:20.753188 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: *** uWSGI is running in multiple interpreter mode *** May 10 16:30:20.753188 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: spawned uWSGI master process (pid: 81308) May 10 16:30:20.753390 dv-cinder-841302-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 16:30:20.754739 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: spawned uWSGI worker 1 (pid: 81322, cores: 1) May 10 16:30:20.754739 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: spawned uWSGI worker 2 (pid: 81323, cores: 1) May 10 16:30:20.755938 dv-cinder-841302-1-iscsi devstack@keystone.service[81308]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 16:30:26.524112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:30:26.524112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: from cryptography.utils import int_from_bytes May 10 16:30:26.525377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:30:26.525377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: from cryptography.utils import int_from_bytes May 10 16:30:26.528107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:30:26.528107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: from cryptography.utils import int_from_bytes May 10 16:30:26.530823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:30:26.530823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: from cryptography.utils import int_from_bytes May 10 16:30:26.574836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:30:26.575147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:30:26.575239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] command line args: [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:30:26.575539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:30:26.575636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ================================================================================ {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:30:26.575886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] admin_token = **** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.576127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] config_dir = [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.576312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.576493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] config_source = [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.576669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] debug = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.576759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:30:26.576903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.579665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:30:26.579665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] command line args: [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:30:26.579799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.579883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:30:26.579958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580024 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ================================================================================ {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:30:26.580089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] admin_token = **** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] config_dir = [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] list_limit = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] log_config_append = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] config_source = [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] debug = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580716 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] log_dir = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] log_file = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580925 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.580994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] list_limit = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] log_config_append = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] log_dir = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] log_file = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.581939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582818 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.582878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.583850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.584132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.584368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] publish_errors = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.584565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.584753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.584956 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.585183 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.585391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.585592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.585794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.585961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.586195 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.586365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.586365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] standard_threads = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.586365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.586921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.586921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] publish_errors = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.587388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.587388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.587782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.588008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] use_journal = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.588208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.588414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] use_json = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.588578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.588744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] use_stderr = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.588744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] use_syslog = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.589031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.589164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.589304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.589304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] standard_threads = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.589588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.589724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.589863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.589990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.590192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.590329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.590463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.590598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] use_journal = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.590598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] use_json = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.590851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.591009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] use_stderr = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.591145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.591274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] use_syslog = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.591402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.591537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:30:26.591685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.591826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.591955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.592083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.592211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.592338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.592577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.593271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.593416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.593545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.593672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.593800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.593937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.594072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.594200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.594339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.594473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.594603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.594739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.594869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.595018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.595166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.595305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.595434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.595571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.595706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.595834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.595962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.596101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.596235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.596380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.596515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.596645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.596773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.596901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.597030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.597167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.597295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.597423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.597551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.597678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.597850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.597992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.598123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.598251 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.598378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.598506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.598640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.598777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.598906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.599081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.599219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.599355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.599490 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.599734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.599885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.600015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.600149 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.600396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.600564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.600698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.600826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.600954 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.601082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.601210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.601352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.601488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.601627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.601766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.601894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.602021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.602158 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.602294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.602428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.602562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.602690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.602818 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.602954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.603120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.603249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.603387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.603515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.604998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.605248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.605458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.605680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.605848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.606076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.606276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.606482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.606649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.606881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.607194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.607385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.607528 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.607680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.607810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.607970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.608108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.608252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.608393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.608532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.608663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.608792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.608926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.609056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.609184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.609321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.609451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.609591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.609720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.609858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.609988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.610125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.610263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.610394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.610571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.610708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.610837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.611001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.611150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.611282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.611428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.611566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.611699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.611829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.611967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.612109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.612239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.612368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.612509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.612639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.612768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.612906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.613036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.613175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.613304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.613432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.613567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.613706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.613843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.613974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.614102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.614238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.614379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.614509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.614509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.614509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.614879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.615071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.615281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.615414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.615543 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.615678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.615808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.615939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.616076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.616206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.616335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.616464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.616592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.616720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.616858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.617000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.617136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.617266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.617395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.617524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.617662 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.617792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.617920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.618051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.618179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.618307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.618445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.618584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.618740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.618870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.619015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.619153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.619283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.619411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.619555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.619685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.619814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.619949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.620079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.620210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.620347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.620478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.620618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.620748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.620876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.621005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.621142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.621273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.621402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] auth.external = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.621547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.621681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.621811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.621949 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.622081 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.622218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.622348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.622487 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] auth.password = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.622628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.622785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] auth.token = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.622926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] auth.external = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.623123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.623258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.623388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.623518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.623648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.623786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.623929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.624069 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] auth.password = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.624206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.624348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] auth.token = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.624478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.624616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.624747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.624877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.625006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] credential.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.625135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.625265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.625404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.625535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.625665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.625795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.625924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.626053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.626200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.626331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.626461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] credential.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.626590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.626728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.626859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.627017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.627162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.627292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.627421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.627552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.627681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.627820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.627967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.628098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.628226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.628362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.628493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.628631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.628762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.628891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.629020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.629162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.629292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] federation.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.629430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.629570 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.629701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.629840 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.629971 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.630100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.630238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.630369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.630498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.630629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.630759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] federation.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.630889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.631177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.631331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.631470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.631610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.631753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.631883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.632085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.632230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.632362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.632493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.632622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.633236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.634412 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.635466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.637142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.638755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.638910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.639092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.639257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.639394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.640028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.640161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.640300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.640438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.640579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.640710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.640840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.640971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.641102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.641242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.641373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.641521 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.641657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.641788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.641924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.642064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.642197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.642327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.642464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.642595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.642725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.642864 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.643014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.643151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.643284 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.643424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.643565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.643705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.643836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.643973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.644103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.644234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.644364 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.644503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.644634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.644764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.644764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.645010 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.645151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.645291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.645423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.645552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.645682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.645811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.645941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.646084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.646215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.646346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.646476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.646606 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.646735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.646875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.647069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.647208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.647339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.647470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.647648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.647791 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.647924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.648054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.648184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.648314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.648452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.648592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.648730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.648867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.648867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.649143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.649372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.649550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.649686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.649815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.649946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.650077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.650215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.650355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.650487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.650618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.650748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.650888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.651075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.651239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.651373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.651511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.651647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.651778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.651778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.652033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.652164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.652293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.652423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.652552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.652683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.652835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.652967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.653097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.653097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.653344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.653473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.653611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.653743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.653873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.654002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.654131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.654131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.654385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.654385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.654644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.654644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.654891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.655136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.655807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.655950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.656080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.656209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.656339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.656339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.656595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.656725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.656856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.656995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.657125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.657263 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.657395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.657525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.657655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.657784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.657915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.658053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.658184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.658313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.658443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.658573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.658702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.658850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.659016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.659154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.659285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.659416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.659546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.659688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.659819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.659950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.660080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.660211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.660341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.660479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.660620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.660757 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.660888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.661018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.661148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.661285 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.661415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.661552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.661686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.661816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.661945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.662084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.662215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.662344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.662484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.662613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.662742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.662881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.663031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.663168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.663299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] resource.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.663428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.663557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.663762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.663895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.664025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.664156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.664285 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.664425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.664564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.664694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.664824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] resource.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.664953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.665083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.665214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.665353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.665484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.670539 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.673590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.673751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.673897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] role.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.674055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.674212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] role.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.674353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.674492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.674632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.674771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.674919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.675085 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.675227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.675364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.675501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] role.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.675637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.675806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] role.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.675947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.676096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.676233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.676370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.676507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.676653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.676793 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.676929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.677066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.677202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.677348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.677487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.677624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.677764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.677911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.678048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.678194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.678333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.678333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.678593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.678730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.678867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.679038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.679038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.679309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.679446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.679584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.679721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.679882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.680023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.680158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.680295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.680432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.680569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.680714 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.680852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.680990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.681126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.681263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.681399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.681545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.681694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.681831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.681970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.682106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.682243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.682389 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.682527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.682663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.682800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.682936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.683175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.683456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.683618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.683771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.683908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.684044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.684191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.684330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] token.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.684515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.684659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.684796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.684933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.685080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.685220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.685358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] token.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.685495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.685633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.685784 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.685936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.686075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.686265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.686439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.686579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.686716 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.686862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.687016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.687161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.687299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.687436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.687582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.687729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.687879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.688017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.688153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.688292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.688428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.688573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.688711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.688848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.688992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.689134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.689271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.689416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.689554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.connection = **** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.689709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.689857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.689996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.690133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.690270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.690408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.690553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.connection = **** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.690700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.690846 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.691996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.692954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.693026 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.693026 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:30:26.693167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.693167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.693167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.693167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:30:26.693167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:30:26.694501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.694734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.694955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.699666 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.699908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.700133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.704206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.709783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.732588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.732817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.736832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.737068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.785776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.786382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.836653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.836917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.837619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.837858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.907943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.908254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.908337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.908402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.931451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.931679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.931835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.931919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.932943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.933192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.944654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.944969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.960465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.960677 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.960794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.960918 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.961139 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.961231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.961351 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.961458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.961574 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.961789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.961875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.961996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.962103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.962441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:30:26.979360 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.979576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 16:30:26.979747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.979919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.980002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 16:30:26.980170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 16:30:26.980252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.980414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.980494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 16:30:26.980667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.980748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.980911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.980992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.981155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.981244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.981427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.992307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.992474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.992622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.992765 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.992858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.993031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.993112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:26.993280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.001831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.002372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.005170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.005453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.005672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.005846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.005947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.006124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.006209 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.006402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.006581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.006669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.006861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.006945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.007154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.007237 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.007402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.007497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.007666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.007747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.007922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.008006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.008193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.008445 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.035173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.035480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.036838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.037080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.037237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.037386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.042418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.042600 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.042761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.042912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.043079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.043220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.050570 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.050730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.050883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.051053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.055535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.055686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.055825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.055978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.056129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.056269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.056408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.056546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.056683 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.058400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.059434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.061065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.063315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.063481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.063657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.063810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.078333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.078618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.080991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.081510 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.083559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.086651 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.087298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.087595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.090870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.091341 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.092696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.097538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.097854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.102769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.103098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.103390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.103671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.103950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.104129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.104313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.108260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.108701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.109128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.109545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.109976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.110393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.123684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.124591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.124867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.125133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.131219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.131751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.132155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.132681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.133125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.134868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.135179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.138266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.138547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.138834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.139164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.139467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.142663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.144635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.145046 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.148302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.148721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.149500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.149944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.150365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.154477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.154759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.155077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.155375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.155654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.155944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.156220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.165980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.166406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.166826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.167310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.167733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.168151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.168560 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.177293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.181508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.187518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.187518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.189104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.189387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.189672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.196908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.197307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.198923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.200780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.202774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.203089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.203379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.203655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.205630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.207411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.209246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.209626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.209918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.213048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.213512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.213936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.220281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.222075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.222955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=81322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.223270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.223901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.224190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.224474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.224757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.225031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.225310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.225580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.225856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.226117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.226556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.226983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.227086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.227331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.227627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.227730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.227910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.248049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.248358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.249767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.259960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=81323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:30:27.260382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.260774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.261110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.261502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.261877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.262267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.262645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.263635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.263739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.264102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.264516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.264878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.265247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:30:27.278777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5614ec0e99c0 pid: 81322 (default app) May 10 16:30:27.282519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0eaf3-57e0-4341-9ec2-d7381e216b39 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:27.282827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0eaf3-57e0-4341-9ec2-d7381e216b39 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:27.283143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0eaf3-57e0-4341-9ec2-d7381e216b39 None None] PATH_INFO: `/v3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:27.289163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Tue May 10 16:30:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:27.310533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5614ec0e99c0 pid: 81323 (default app) May 10 16:30:35.370925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5190c-55fb-4c9e-a8e9-fc7b665f6b48 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:35.371523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5190c-55fb-4c9e-a8e9-fc7b665f6b48 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:35.371523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5190c-55fb-4c9e-a8e9-fc7b665f6b48 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:35.372828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:30:35.380144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:35.380562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:35.380710 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:35.411837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG oslo_db.sqlalchemy.engines [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:30:35.599105 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG passlib.handlers.bcrypt [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81323) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 16:30:35.599567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG passlib.handlers.bcrypt [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81323) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 16:30:35.657201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:35.659230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:35.799240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 16:30:35.922671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5190c-55fb-4c9e-a8e9-fc7b665f6b48 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:35.956927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG oslo_db.sqlalchemy.engines [None req-baa5190c-55fb-4c9e-a8e9-fc7b665f6b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:30:36.086014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5190c-55fb-4c9e-a8e9-fc7b665f6b48 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:36.090254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5e57f-089f-4914-8754-12eacce13aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:36.090920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5e57f-089f-4914-8754-12eacce13aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:36.091233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5e57f-089f-4914-8754-12eacce13aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:36.091512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5e57f-089f-4914-8754-12eacce13aa8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:36.099733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5e57f-089f-4914-8754-12eacce13aa8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:36.151773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING keystone.common.rbac_enforcer.enforcer [None req-08b5e57f-089f-4914-8754-12eacce13aa8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 16:30:36.152113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5e57f-089f-4914-8754-12eacce13aa8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:36.162454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1324 bytes} [Tue May 10 16:30:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:30:36.168363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:36.183189 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56388522-e1bc-4b61-8f32-e84572b7bbc6 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:36.188042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4452b6-6b19-43fe-ac02-c89341e07819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:36.189148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4452b6-6b19-43fe-ac02-c89341e07819 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:36.189428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4452b6-6b19-43fe-ac02-c89341e07819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:36.189711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4452b6-6b19-43fe-ac02-c89341e07819 admin admin] PATH_INFO: `/v3/projects/4f2ab0bb70f249b18504d9e6616306cf` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:36.191242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4452b6-6b19-43fe-ac02-c89341e07819 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f2ab0bb70f249b18504d9e6616306cf)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:36.241980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a4452b6-6b19-43fe-ac02-c89341e07819 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 16:30:36.242318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4452b6-6b19-43fe-ac02-c89341e07819 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:36.246890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 2/5] 10.222.0.57 () {56 vars in 1207 bytes} [Tue May 10 16:30:36 2022] GET /identity/v3/projects/4f2ab0bb70f249b18504d9e6616306cf => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:38.450356 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20803-6aa5-403a-aece-dbf7aaff86c8 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:38.450917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20803-6aa5-403a-aece-dbf7aaff86c8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:38.450917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d20803-6aa5-403a-aece-dbf7aaff86c8 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:38.455619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 4/6] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:30:38.461079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8595b4-1f28-4764-9676-67653c7112ec None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:38.461470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8595b4-1f28-4764-9676-67653c7112ec None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:38.461630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8595b4-1f28-4764-9676-67653c7112ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:38.481718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-7e8595b4-1f28-4764-9676-67653c7112ec None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:38.483283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7e8595b4-1f28-4764-9676-67653c7112ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:38.491270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 16:30:38.513179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d20803-6aa5-403a-aece-dbf7aaff86c8 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:38.525577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d20803-6aa5-403a-aece-dbf7aaff86c8 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:38.529773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e676c7b-eede-4b21-8e28-ab4445ad1f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:38.530987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676c7b-eede-4b21-8e28-ab4445ad1f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:38.531281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676c7b-eede-4b21-8e28-ab4445ad1f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:38.531556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676c7b-eede-4b21-8e28-ab4445ad1f65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:38.539097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e676c7b-eede-4b21-8e28-ab4445ad1f65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:38.540861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e676c7b-eede-4b21-8e28-ab4445ad1f65 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:38.549665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1324 bytes} [Tue May 10 16:30:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:30:38.554797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8595b4-1f28-4764-9676-67653c7112ec None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:38.564389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8595b4-1f28-4764-9676-67653c7112ec None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:38.568681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0de45-73db-4abe-8183-cd7728e2fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:38.569544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0de45-73db-4abe-8183-cd7728e2fa0f admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:38.569824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0de45-73db-4abe-8183-cd7728e2fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:38.570096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0de45-73db-4abe-8183-cd7728e2fa0f admin admin] PATH_INFO: `/v3/users/0464ce0cc2c244588f440cfed98f23ff` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:38.571523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0de45-73db-4abe-8183-cd7728e2fa0f admin admin] RBAC: Authorizing `identity:get_user(user_id=0464ce0cc2c244588f440cfed98f23ff)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:38.573331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0de45-73db-4abe-8183-cd7728e2fa0f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:38.574897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 4/9] 10.222.0.57 () {56 vars in 1198 bytes} [Tue May 10 16:30:38 2022] GET /identity/v3/users/0464ce0cc2c244588f440cfed98f23ff => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:40.860043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37510-8fd1-4d99-8ecc-6064fa065b15 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:40.860593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37510-8fd1-4d99-8ecc-6064fa065b15 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:40.860593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37510-8fd1-4d99-8ecc-6064fa065b15 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:40.861945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:40.867304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aebfec-84a8-4d5a-a1b4-70096a9ee3b9 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:40.867677 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aebfec-84a8-4d5a-a1b4-70096a9ee3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:40.867861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aebfec-84a8-4d5a-a1b4-70096a9ee3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:40.895446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8348-28a3-4014-b9a7-c34465896a18 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:40.895734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8348-28a3-4014-b9a7-c34465896a18 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:40.896012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8348-28a3-4014-b9a7-c34465896a18 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:40.897388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 7/11] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:30:40.903393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:40.903674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:40.903947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:40.945975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG passlib.handlers.bcrypt [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81322) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 16:30:40.946391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG passlib.handlers.bcrypt [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81322) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 16:30:40.993112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:40.993621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-09aebfec-84a8-4d5a-a1b4-70096a9ee3b9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:40.994735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:40.994838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-09aebfec-84a8-4d5a-a1b4-70096a9ee3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:41.072405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:41.090861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:30:41.095669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aebfec-84a8-4d5a-a1b4-70096a9ee3b9 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:41.113038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:41.190134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aebfec-84a8-4d5a-a1b4-70096a9ee3b9 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:41.206572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac5197-e365-4fc4-b37b-3b7a935c725d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:41.222460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be99a0-2d4e-4fd2-8f45-ae76d1618c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:41.223277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be99a0-2d4e-4fd2-8f45-ae76d1618c24 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:41.223555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be99a0-2d4e-4fd2-8f45-ae76d1618c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:41.223823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be99a0-2d4e-4fd2-8f45-ae76d1618c24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:41.234803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be99a0-2d4e-4fd2-8f45-ae76d1618c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:30:41.239147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a73eb-808f-4b78-b9e5-3be3196ae3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:41.240038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a73eb-808f-4b78-b9e5-3be3196ae3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:41.240325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a73eb-808f-4b78-b9e5-3be3196ae3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:41.240604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a73eb-808f-4b78-b9e5-3be3196ae3e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-44be99a0-2d4e-4fd2-8f45-ae76d1618c24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:30:41.246682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:41.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:30:41.253430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 6/14] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:30:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:30:41.254119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be99a0-2d4e-4fd2-8f45-ae76d1618c24 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:41.307873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a73eb-808f-4b78-b9e5-3be3196ae3e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:41.309402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a73eb-808f-4b78-b9e5-3be3196ae3e7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:41.347045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be99a0-2d4e-4fd2-8f45-ae76d1618c24 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:41.378557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:41.379179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:41.379528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:41.379800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:41.380545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:41.380846 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:41.382228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:41.393523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 7/15] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:30:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:41.399266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:41.403622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:30:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:30:41.409597 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a73eb-808f-4b78-b9e5-3be3196ae3e7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:41.493238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484da1c-7f11-47a3-ba76-46d63985721f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:41.503757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a73eb-808f-4b78-b9e5-3be3196ae3e7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:41.526323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87159463-78a3-4db8-9ee7-2d28854b5eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:41.527217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159463-78a3-4db8-9ee7-2d28854b5eca None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:41.527498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159463-78a3-4db8-9ee7-2d28854b5eca None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:41.527769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159463-78a3-4db8-9ee7-2d28854b5eca None admin] PATH_INFO: `/v3/users/0464ce0cc2c244588f440cfed98f23ff` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:41.528961 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87159463-78a3-4db8-9ee7-2d28854b5eca None admin] RBAC: Authorizing `identity:get_user(user_id=0464ce0cc2c244588f440cfed98f23ff)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:41.530991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87159463-78a3-4db8-9ee7-2d28854b5eca None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:41.532604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 8/17] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:30:41 2022] GET /identity/v3/users/0464ce0cc2c244588f440cfed98f23ff => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:41.536005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:41.536800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:41.537086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:41.537357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:41.537769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87159463-78a3-4db8-9ee7-2d28854b5eca None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:41.638084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87159463-78a3-4db8-9ee7-2d28854b5eca None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:41.663323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:41.664782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:41.671881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5d2b3-d54e-4b61-88ba-635d526a5515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:41.672670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5d2b3-d54e-4b61-88ba-635d526a5515 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:41.672951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5d2b3-d54e-4b61-88ba-635d526a5515 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:41.673217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5d2b3-d54e-4b61-88ba-635d526a5515 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:41.674374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5d2b3-d54e-4b61-88ba-635d526a5515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:41.675811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5d2b3-d54e-4b61-88ba-635d526a5515 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:41.677396 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:41.682888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5d2b3-d54e-4b61-88ba-635d526a5515 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:30:41.685767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:41.686663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:41.687719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:30:41.687719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:30:41.687719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:30:41.687719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:30:41.687719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:30:41.692617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:41.775741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5d2b3-d54e-4b61-88ba-635d526a5515 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:41.786932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee58199-6cb9-47ea-8446-8443673b6bc4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:41.807777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5499a02-0555-4c5f-b982-c62af6fc6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:41.808432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499a02-0555-4c5f-b982-c62af6fc6892 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:41.808713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499a02-0555-4c5f-b982-c62af6fc6892 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:41.808987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499a02-0555-4c5f-b982-c62af6fc6892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:41.809815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5499a02-0555-4c5f-b982-c62af6fc6892 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.domain.id=default, user.id=0464ce0cc2c244588f440cfed98f23ff) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:41.810126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5499a02-0555-4c5f-b982-c62af6fc6892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:41.811608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5499a02-0555-4c5f-b982-c62af6fc6892 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:41.818176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1322 bytes} [Tue May 10 16:30:41 2022] GET /identity/v3/role_assignments?user.id=0464ce0cc2c244588f440cfed98f23ff&scope.domain.id=default&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 233 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:41.818454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf1127-e936-451e-8c77-21f20ecee35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:41.819147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1127-e936-451e-8c77-21f20ecee35c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:41.819428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1127-e936-451e-8c77-21f20ecee35c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:41.819702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1127-e936-451e-8c77-21f20ecee35c None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:41.820428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf1127-e936-451e-8c77-21f20ecee35c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:41.820736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf1127-e936-451e-8c77-21f20ecee35c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:41.822128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf1127-e936-451e-8c77-21f20ecee35c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:41.841851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:44.629787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201795d-bed0-4c1f-8675-6d89cb854976 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:44.630824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201795d-bed0-4c1f-8675-6d89cb854976 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:44.631358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201795d-bed0-4c1f-8675-6d89cb854976 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:44.633265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:44.638312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810287-099a-4c96-bbef-628de6504fec None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:44.639695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810287-099a-4c96-bbef-628de6504fec None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:44.640198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810287-099a-4c96-bbef-628de6504fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:44.652403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ca1c-64bc-4e12-b155-b81ae921cd4b None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:44.652952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ca1c-64bc-4e12-b155-b81ae921cd4b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:44.653455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ca1c-64bc-4e12-b155-b81ae921cd4b None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:44.655602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 12/23] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:44.661608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b7682-f4f0-48b3-8109-35b182904e52 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:44.662169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b7682-f4f0-48b3-8109-35b182904e52 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:44.662649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b7682-f4f0-48b3-8109-35b182904e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:44.680985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e4810287-099a-4c96-bbef-628de6504fec None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:44.682500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e4810287-099a-4c96-bbef-628de6504fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:44.694235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-c97b7682-f4f0-48b3-8109-35b182904e52 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:44.695773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c97b7682-f4f0-48b3-8109-35b182904e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:44.776359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:44.778232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c196f8-be78-458c-9302-ea49dbdcc604 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:44.778736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c196f8-be78-458c-9302-ea49dbdcc604 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:44.779213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 13/25] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:30:44.779467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c196f8-be78-458c-9302-ea49dbdcc604 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:44.781151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274a664-f44b-4277-846b-6b16dc6fb0e5 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:44.781436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274a664-f44b-4277-846b-6b16dc6fb0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:44.781709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274a664-f44b-4277-846b-6b16dc6fb0e5 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:44.782439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 13/26] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:44.783192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:44.791882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574cb52-c204-4215-b482-5967dcd061e9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:44.792025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cc5a8-b1f8-4661-a824-46775fd5276a None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:44.792218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cc5a8-b1f8-4661-a824-46775fd5276a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:44.792650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574cb52-c204-4215-b482-5967dcd061e9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:44.792789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cc5a8-b1f8-4661-a824-46775fd5276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:44.793118 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574cb52-c204-4215-b482-5967dcd061e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:44.811952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-234cc5a8-b1f8-4661-a824-46775fd5276a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:44.813391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-234cc5a8-b1f8-4661-a824-46775fd5276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:44.816206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1574cb52-c204-4215-b482-5967dcd061e9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:44.817615 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1574cb52-c204-4215-b482-5967dcd061e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:44.889785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 14/28] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:44.890952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574cb52-c204-4215-b482-5967dcd061e9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:44.895095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 15/29] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:30:44.900329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cc5a8-b1f8-4661-a824-46775fd5276a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:45.017336 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cc5a8-b1f8-4661-a824-46775fd5276a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.024695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574cb52-c204-4215-b482-5967dcd061e9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.062342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a0d65-032d-46ff-8180-6239fb472e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.063618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a0d65-032d-46ff-8180-6239fb472e0d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.064039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a0d65-032d-46ff-8180-6239fb472e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.064447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a0d65-032d-46ff-8180-6239fb472e0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.066627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8d80-6a71-46a5-a5b1-a3b4227a759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.067556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8d80-6a71-46a5-a5b1-a3b4227a759c None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.068018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8d80-6a71-46a5-a5b1-a3b4227a759c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.068462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea8d80-6a71-46a5-a5b1-a3b4227a759c None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.069397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea8d80-6a71-46a5-a5b1-a3b4227a759c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:45.070986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea8d80-6a71-46a5-a5b1-a3b4227a759c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:45.075469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a0d65-032d-46ff-8180-6239fb472e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d85a0d65-032d-46ff-8180-6239fb472e0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:30:45.087331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:45.088223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:30:45.089014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 16/30] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:30:45.089779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a0d65-032d-46ff-8180-6239fb472e0d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:45.191860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a0d65-032d-46ff-8180-6239fb472e0d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.199690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 15/31] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 16:30:44 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:30:45.200866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8d80-6a71-46a5-a5b1-a3b4227a759c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:45.233887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff680b9-2ffd-4e41-b2b6-6441ebc78e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.235005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff680b9-2ffd-4e41-b2b6-6441ebc78e06 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.235293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff680b9-2ffd-4e41-b2b6-6441ebc78e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.235570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff680b9-2ffd-4e41-b2b6-6441ebc78e06 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.236670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff680b9-2ffd-4e41-b2b6-6441ebc78e06 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:45.238122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff680b9-2ffd-4e41-b2b6-6441ebc78e06 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:45.345635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea8d80-6a71-46a5-a5b1-a3b4227a759c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.387222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 17/32] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 16:30:45 2022] POST /identity/v3/roles => generated 225 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:30:45.388805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff680b9-2ffd-4e41-b2b6-6441ebc78e06 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:45.439190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.440015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.440300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.440576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.455243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:45.456799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:30:45.487147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:45.488036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:45.488859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:30:45.488859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:30:45.488859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:30:45.488859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:30:45.488859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 16/33] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:30:45.495413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:45.551087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff680b9-2ffd-4e41-b2b6-6441ebc78e06 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.630357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.631064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.631339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.632260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.632378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:45.632694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:45.634269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:45.638700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09652c-ddef-4326-a695-0fc1e24a6bda None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.658899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 18/34] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:30:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:45.660223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:45.679403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.680345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.680594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.680874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.681619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:45.681931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:45.683455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:45.698784 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 17/35] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:45.704904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:45.774550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5c39-8c49-49a8-8e56-39bde93589e0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.807082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938948a-5f5d-450d-8e6c-2e76b15d4edb None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.808348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2c666-7433-4b33-ac3c-443dd96b23b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.809224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c666-7433-4b33-ac3c-443dd96b23b8 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.809499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c666-7433-4b33-ac3c-443dd96b23b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.809775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2c666-7433-4b33-ac3c-443dd96b23b8 None admin] PATH_INFO: `/v3/users/0464ce0cc2c244588f440cfed98f23ff` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.811664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2c666-7433-4b33-ac3c-443dd96b23b8 None admin] RBAC: Authorizing `identity:get_user(user_id=0464ce0cc2c244588f440cfed98f23ff)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:45.814123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2c666-7433-4b33-ac3c-443dd96b23b8 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:45.820238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 19/36] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:30:45 2022] GET /identity/v3/users/0464ce0cc2c244588f440cfed98f23ff => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:45.821479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2c666-7433-4b33-ac3c-443dd96b23b8 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:45.843809 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01fe3-d137-41fe-8da5-214aecfac055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.844539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01fe3-d137-41fe-8da5-214aecfac055 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.844823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01fe3-d137-41fe-8da5-214aecfac055 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.845156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01fe3-d137-41fe-8da5-214aecfac055 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.846173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a01fe3-d137-41fe-8da5-214aecfac055 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:45.847734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a01fe3-d137-41fe-8da5-214aecfac055 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:45.892566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:30:45 2022] POST /identity/v3/projects => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:30:45.954839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2c666-7433-4b33-ac3c-443dd96b23b8 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:45.995349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddc549-1e83-4e51-a68e-d0005d2cc49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:45.996238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc549-1e83-4e51-a68e-d0005d2cc49e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:45.996535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc549-1e83-4e51-a68e-d0005d2cc49e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:45.996844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc549-1e83-4e51-a68e-d0005d2cc49e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:45.998289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddc549-1e83-4e51-a68e-d0005d2cc49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:46.000516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddc549-1e83-4e51-a68e-d0005d2cc49e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:46.002481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:46.008567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01fe3-d137-41fe-8da5-214aecfac055 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:46.123152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01fe3-d137-41fe-8da5-214aecfac055 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:46.158599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7d57b-f847-4e6f-bc97-c17c3459854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:46.159888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7d57b-f847-4e6f-bc97-c17c3459854c None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:46.160405 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7d57b-f847-4e6f-bc97-c17c3459854c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:46.160859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7d57b-f847-4e6f-bc97-c17c3459854c None admin] PATH_INFO: `/v3/domains/default/users/0464ce0cc2c244588f440cfed98f23ff/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:46.163165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7d57b-f847-4e6f-bc97-c17c3459854c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0464ce0cc2c244588f440cfed98f23ff, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:46.164630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7d57b-f847-4e6f-bc97-c17c3459854c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:46.183458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 19/39] 10.222.0.57 () {58 vars in 1361 bytes} [Tue May 10 16:30:46 2022] PUT /identity/v3/domains/default/users/0464ce0cc2c244588f440cfed98f23ff/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:30:46.205970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10881e3-4d39-479d-97e0-bb8980c2cac3 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:46.206299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10881e3-4d39-479d-97e0-bb8980c2cac3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:46.206537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10881e3-4d39-479d-97e0-bb8980c2cac3 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:46.208013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 21/40] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:46.214334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620a053-4c7b-44b5-a0e1-7add9b80c543 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:46.214649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620a053-4c7b-44b5-a0e1-7add9b80c543 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:46.214933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620a053-4c7b-44b5-a0e1-7add9b80c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:46.233929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8620a053-4c7b-44b5-a0e1-7add9b80c543 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:46.235687 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8620a053-4c7b-44b5-a0e1-7add9b80c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:46.280207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6c40-3f12-4785-812f-b5afcae9137a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:46.280523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6c40-3f12-4785-812f-b5afcae9137a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:46.280782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6c40-3f12-4785-812f-b5afcae9137a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:46.282358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 22/41] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:30:46.287777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1b41-a19c-4665-a3b8-644b1dba6c86 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:46.288074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1b41-a19c-4665-a3b8-644b1dba6c86 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:46.288357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1b41-a19c-4665-a3b8-644b1dba6c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:46.305769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 20/42] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:46.306103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-a0bb1b41-a19c-4665-a3b8-644b1dba6c86 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:46.307755 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a0bb1b41-a19c-4665-a3b8-644b1dba6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:46.328812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620a053-4c7b-44b5-a0e1-7add9b80c543 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:46.379299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 23/43] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:30:46.402114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1b41-a19c-4665-a3b8-644b1dba6c86 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:46.432429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620a053-4c7b-44b5-a0e1-7add9b80c543 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:46.465848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33604a32-5b4a-44d1-ba22-e3c33e0a1ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:46.466525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604a32-5b4a-44d1-ba22-e3c33e0a1ca7 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:46.466870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604a32-5b4a-44d1-ba22-e3c33e0a1ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:46.467700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604a32-5b4a-44d1-ba22-e3c33e0a1ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:46.468473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33604a32-5b4a-44d1-ba22-e3c33e0a1ca7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:46.469879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33604a32-5b4a-44d1-ba22-e3c33e0a1ca7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:46.484608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 21/44] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 16:30:46 2022] POST /identity/v3/roles => generated 223 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:30:46.503682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1b41-a19c-4665-a3b8-644b1dba6c86 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:46.539977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20853cf-a2fd-4751-83c4-1f5728812aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:46.540792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20853cf-a2fd-4751-83c4-1f5728812aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:46.541073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20853cf-a2fd-4751-83c4-1f5728812aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:46.541344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20853cf-a2fd-4751-83c4-1f5728812aa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:46.542615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20853cf-a2fd-4751-83c4-1f5728812aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:46.544553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20853cf-a2fd-4751-83c4-1f5728812aa8 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:46.547161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 24/45] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:46.552867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33604a32-5b4a-44d1-ba22-e3c33e0a1ca7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:46.654252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33604a32-5b4a-44d1-ba22-e3c33e0a1ca7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:46.691443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd0d5-645b-4edf-ba11-8b4016192adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:46.692137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd0d5-645b-4edf-ba11-8b4016192adf None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:46.692425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd0d5-645b-4edf-ba11-8b4016192adf None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:46.692706 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd0d5-645b-4edf-ba11-8b4016192adf None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:46.693435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dd0d5-645b-4edf-ba11-8b4016192adf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:46.694907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dd0d5-645b-4edf-ba11-8b4016192adf None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:46.729006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 22/46] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:30:46 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:30:48.434031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf0ce6-9578-48c7-87f6-00c58e9c579d None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:48.434548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf0ce6-9578-48c7-87f6-00c58e9c579d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:48.434660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf0ce6-9578-48c7-87f6-00c58e9c579d None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:48.436069 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 25/47] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:48.441354 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed104-f693-4f2f-bebc-f867fd6a8fd4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:48.441772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed104-f693-4f2f-bebc-f867fd6a8fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:48.441913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed104-f693-4f2f-bebc-f867fd6a8fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:48.458548 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-974ed104-f693-4f2f-bebc-f867fd6a8fd4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:48.459768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-974ed104-f693-4f2f-bebc-f867fd6a8fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:48.522336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 23/48] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:48.545458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf0ce6-9578-48c7-87f6-00c58e9c579d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:48.642307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf0ce6-9578-48c7-87f6-00c58e9c579d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:48.674328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207b861-f7ed-4b19-ab41-7881aa8f569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:48.675163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b861-f7ed-4b19-ab41-7881aa8f569f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:48.675453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b861-f7ed-4b19-ab41-7881aa8f569f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:48.675731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207b861-f7ed-4b19-ab41-7881aa8f569f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:48.685400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207b861-f7ed-4b19-ab41-7881aa8f569f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-e207b861-f7ed-4b19-ab41-7881aa8f569f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:30:48.693552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:48.694656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:30:48.695472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 26/49] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:30:48.700517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed104-f693-4f2f-bebc-f867fd6a8fd4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:48.798272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed104-f693-4f2f-bebc-f867fd6a8fd4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:48.830539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178c999-4e66-4d1a-985a-0399a90fbc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:48.831232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c999-4e66-4d1a-985a-0399a90fbc33 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:48.831525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c999-4e66-4d1a-985a-0399a90fbc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:48.831786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c999-4e66-4d1a-985a-0399a90fbc33 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:48.832528 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178c999-4e66-4d1a-985a-0399a90fbc33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:48.832833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178c999-4e66-4d1a-985a-0399a90fbc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:48.834206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178c999-4e66-4d1a-985a-0399a90fbc33 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:48.845281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 24/50] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:48.850597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207b861-f7ed-4b19-ab41-7881aa8f569f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:48.934350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52041a4-53f2-4307-965e-f742e4da3372 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:48.934638 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52041a4-53f2-4307-965e-f742e4da3372 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:48.934919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52041a4-53f2-4307-965e-f742e4da3372 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:48.937025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 25/51] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:30:48.941726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763ac61-8af1-4c5a-a046-55d287fc8dd6 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:48.942005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763ac61-8af1-4c5a-a046-55d287fc8dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:48.942280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763ac61-8af1-4c5a-a046-55d287fc8dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:48.946778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207b861-f7ed-4b19-ab41-7881aa8f569f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:48.959779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d763ac61-8af1-4c5a-a046-55d287fc8dd6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:48.960959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d763ac61-8af1-4c5a-a046-55d287fc8dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:48.979965 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d088152-4cc6-46e5-816b-8d4323ea0282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:48.980841 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088152-4cc6-46e5-816b-8d4323ea0282 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:48.981127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088152-4cc6-46e5-816b-8d4323ea0282 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:48.981403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088152-4cc6-46e5-816b-8d4323ea0282 None admin] PATH_INFO: `/v3/users/0464ce0cc2c244588f440cfed98f23ff` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:48.982628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d088152-4cc6-46e5-816b-8d4323ea0282 None admin] RBAC: Authorizing `identity:get_user(user_id=0464ce0cc2c244588f440cfed98f23ff)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:48.984687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d088152-4cc6-46e5-816b-8d4323ea0282 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:48.986328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 27/52] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:30:48 2022] GET /identity/v3/users/0464ce0cc2c244588f440cfed98f23ff => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:48.991591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d088152-4cc6-46e5-816b-8d4323ea0282 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:49.023159 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 26/53] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:30:49.046662 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763ac61-8af1-4c5a-a046-55d287fc8dd6 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:49.084943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d088152-4cc6-46e5-816b-8d4323ea0282 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:49.116194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0f67-8ea9-4f62-90d9-db80c8536cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:49.116985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0f67-8ea9-4f62-90d9-db80c8536cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:49.117269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0f67-8ea9-4f62-90d9-db80c8536cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:49.117546 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0f67-8ea9-4f62-90d9-db80c8536cc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:49.118727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0f67-8ea9-4f62-90d9-db80c8536cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:49.120230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0f67-8ea9-4f62-90d9-db80c8536cc0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:49.121857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 28/54] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:49.127974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0f67-8ea9-4f62-90d9-db80c8536cc0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:49.138393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763ac61-8af1-4c5a-a046-55d287fc8dd6 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:49.171142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45349128-a344-4c50-962d-2318f92ef387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:49.171941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45349128-a344-4c50-962d-2318f92ef387 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:49.172221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45349128-a344-4c50-962d-2318f92ef387 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:49.172495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45349128-a344-4c50-962d-2318f92ef387 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:49.173667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45349128-a344-4c50-962d-2318f92ef387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:49.175142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45349128-a344-4c50-962d-2318f92ef387 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:49.176736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:49.182090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45349128-a344-4c50-962d-2318f92ef387 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:49.224795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0f67-8ea9-4f62-90d9-db80c8536cc0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:49.256645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53967da6-daff-41ea-87d0-ff9a0961abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:49.257295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53967da6-daff-41ea-87d0-ff9a0961abce None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:49.257582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53967da6-daff-41ea-87d0-ff9a0961abce None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:49.257860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53967da6-daff-41ea-87d0-ff9a0961abce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:49.258697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53967da6-daff-41ea-87d0-ff9a0961abce None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.domain.id=default, user.id=0464ce0cc2c244588f440cfed98f23ff) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:49.259040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53967da6-daff-41ea-87d0-ff9a0961abce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:49.260479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53967da6-daff-41ea-87d0-ff9a0961abce None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:49.266066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 29/56] 10.222.0.57 () {56 vars in 1322 bytes} [Tue May 10 16:30:49 2022] GET /identity/v3/role_assignments?user.id=0464ce0cc2c244588f440cfed98f23ff&scope.domain.id=default&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:49.273369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45349128-a344-4c50-962d-2318f92ef387 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:49.309487 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eed63-6754-46e4-a9f5-913c881610bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:49.310159 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eed63-6754-46e4-a9f5-913c881610bc None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:49.310442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eed63-6754-46e4-a9f5-913c881610bc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:49.310715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eed63-6754-46e4-a9f5-913c881610bc None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:49.312069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eed63-6754-46e4-a9f5-913c881610bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:49.313539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eed63-6754-46e4-a9f5-913c881610bc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:49.339938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 28/57] 10.222.0.57 () {60 vars in 1140 bytes} [Tue May 10 16:30:49 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:30:51.565241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd46f-90aa-4792-ba7b-c851ed012504 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:51.565764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd46f-90aa-4792-ba7b-c851ed012504 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:51.565846 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd46f-90aa-4792-ba7b-c851ed012504 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:51.567204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 30/58] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:51.572426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff1d1c-db0a-4667-92ba-a18377205791 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:51.572825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff1d1c-db0a-4667-92ba-a18377205791 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:51.572981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff1d1c-db0a-4667-92ba-a18377205791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:51.589541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8aff1d1c-db0a-4667-92ba-a18377205791 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:51.590722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8aff1d1c-db0a-4667-92ba-a18377205791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:51.653589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 29/59] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:51.677856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bd46f-90aa-4792-ba7b-c851ed012504 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:51.772921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bd46f-90aa-4792-ba7b-c851ed012504 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:51.803759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7c69-739b-4a5f-8510-3c35eb885e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:51.804541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7c69-739b-4a5f-8510-3c35eb885e4a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:51.804824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7c69-739b-4a5f-8510-3c35eb885e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:51.805101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7c69-739b-4a5f-8510-3c35eb885e4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:51.806261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7c69-739b-4a5f-8510-3c35eb885e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:51.807727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d7c69-739b-4a5f-8510-3c35eb885e4a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:51.809313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 31/60] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:51.815315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff1d1c-db0a-4667-92ba-a18377205791 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:51.914114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff1d1c-db0a-4667-92ba-a18377205791 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:51.945596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f66b4-69e1-4ab1-a653-664da5f32902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:51.946257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f66b4-69e1-4ab1-a653-664da5f32902 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:51.946538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f66b4-69e1-4ab1-a653-664da5f32902 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:51.946812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f66b4-69e1-4ab1-a653-664da5f32902 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:51.947550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f66b4-69e1-4ab1-a653-664da5f32902 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:51.948996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f66b4-69e1-4ab1-a653-664da5f32902 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:51.975869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 30/61] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:30:51 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:30:55.282735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76252-b4d0-444d-a477-a6b4eb301e54 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.283779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76252-b4d0-444d-a477-a6b4eb301e54 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.284311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76252-b4d0-444d-a477-a6b4eb301e54 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.286161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 32/62] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:55.291263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1aa2-ce4e-4391-a4a0-89dce93969e4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.292097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1aa2-ce4e-4391-a4a0-89dce93969e4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.292590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1aa2-ce4e-4391-a4a0-89dce93969e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.315583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-dd9b1aa2-ce4e-4391-a4a0-89dce93969e4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:55.317122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-dd9b1aa2-ce4e-4391-a4a0-89dce93969e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:55.405596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 31/63] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:55.440299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d76252-b4d0-444d-a477-a6b4eb301e54 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:55.487917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed07dde-f18b-49f9-96f4-a238dd26c4d0 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.488613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed07dde-f18b-49f9-96f4-a238dd26c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.489097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed07dde-f18b-49f9-96f4-a238dd26c4d0 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.490752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 32/64] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:55.496804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4ada-55f7-4a35-84bc-eedf266f0e52 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.497420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4ada-55f7-4a35-84bc-eedf266f0e52 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.497901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4ada-55f7-4a35-84bc-eedf266f0e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.515450 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-059e4ada-55f7-4a35-84bc-eedf266f0e52 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:55.517008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-059e4ada-55f7-4a35-84bc-eedf266f0e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:55.629033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 33/65] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:30:55.629961 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d76252-b4d0-444d-a477-a6b4eb301e54 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:55.673236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6cc6b-e0c0-4448-bb4c-2cf80b1ab7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:55.674406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6cc6b-e0c0-4448-bb4c-2cf80b1ab7df None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.674883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6cc6b-e0c0-4448-bb4c-2cf80b1ab7df None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.675378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6cc6b-e0c0-4448-bb4c-2cf80b1ab7df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.685985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6cc6b-e0c0-4448-bb4c-2cf80b1ab7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:30:55.689170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e4ada-55f7-4a35-84bc-eedf266f0e52 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-f3d6cc6b-e0c0-4448-bb4c-2cf80b1ab7df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:30:55.702987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:55.703878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:30:55.704719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:30:55.711856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 33/66] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:30:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:30:55.717151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bedbd-af62-4fc6-bc66-541c3b474511 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.717151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bedbd-af62-4fc6-bc66-541c3b474511 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.717151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bedbd-af62-4fc6-bc66-541c3b474511 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.717151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 34/67] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:55.720686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bedbd-af62-4fc6-bc66-541c3b474511 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:55.814197 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e4ada-55f7-4a35-84bc-eedf266f0e52 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:55.822421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bedbd-af62-4fc6-bc66-541c3b474511 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:55.850928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f872654-5084-4d6f-950a-5fda079b0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:55.851784 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f872654-5084-4d6f-950a-5fda079b0571 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.852067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f872654-5084-4d6f-950a-5fda079b0571 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.852342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f872654-5084-4d6f-950a-5fda079b0571 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.858275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e514a-ec34-4275-9716-114f21edb29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:55.858982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e514a-ec34-4275-9716-114f21edb29c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.859281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e514a-ec34-4275-9716-114f21edb29c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.859558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e514a-ec34-4275-9716-114f21edb29c None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.860376 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e514a-ec34-4275-9716-114f21edb29c None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:55.860643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e514a-ec34-4275-9716-114f21edb29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:55.862126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e514a-ec34-4275-9716-114f21edb29c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:55.865488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f872654-5084-4d6f-950a-5fda079b0571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:30:55.875454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 35/68] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:30:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:55.875454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426e1ce-84aa-4c23-9b68-0b84398e8e2f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.875454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426e1ce-84aa-4c23-9b68-0b84398e8e2f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.875454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426e1ce-84aa-4c23-9b68-0b84398e8e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-7f872654-5084-4d6f-950a-5fda079b0571 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:30:55.877761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:55.878592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:30:55.879436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:30:55.880023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:30:55.883089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18810-5679-4351-8fb5-ec8961df2d4c None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:55.883089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18810-5679-4351-8fb5-ec8961df2d4c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:55.883089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18810-5679-4351-8fb5-ec8961df2d4c None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:55.883089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 35/70] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:55.883624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c18810-5679-4351-8fb5-ec8961df2d4c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:55.896937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-8426e1ce-84aa-4c23-9b68-0b84398e8e2f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:55.898125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8426e1ce-84aa-4c23-9b68-0b84398e8e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:55.963019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 36/71] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:55.963019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426e1ce-84aa-4c23-9b68-0b84398e8e2f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:55.996157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c18810-5679-4351-8fb5-ec8961df2d4c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.040151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcedebc-83b0-4ae1-8b33-dcf9b712d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.041667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcedebc-83b0-4ae1-8b33-dcf9b712d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.042132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcedebc-83b0-4ae1-8b33-dcf9b712d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.042552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcedebc-83b0-4ae1-8b33-dcf9b712d3e9 None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.062201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcedebc-83b0-4ae1-8b33-dcf9b712d3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:56.064381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcedebc-83b0-4ae1-8b33-dcf9b712d3e9 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:56.066231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 36/72] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:30:55 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:56.068461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa37e-175b-4e03-95e1-ef2c61072ae9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.068898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa37e-175b-4e03-95e1-ef2c61072ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.069333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa37e-175b-4e03-95e1-ef2c61072ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.079533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426e1ce-84aa-4c23-9b68-0b84398e8e2f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.086867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-50ffa37e-175b-4e03-95e1-ef2c61072ae9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:56.088343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-50ffa37e-175b-4e03-95e1-ef2c61072ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:56.118761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.120033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.120368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.120648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.121411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:56.121716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:56.123188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:56.132180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 37/73] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:30:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:56.137229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.160776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 37/74] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:56.162789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad209aa-167d-43b4-8997-446d3f70b321 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.163304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad209aa-167d-43b4-8997-446d3f70b321 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.163780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad209aa-167d-43b4-8997-446d3f70b321 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.165265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 38/75] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:30:56.166180 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad209aa-167d-43b4-8997-446d3f70b321 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.245716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c992d-9baf-45e1-a46c-a8c5c1fd0875 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.277015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad209aa-167d-43b4-8997-446d3f70b321 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.279711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355c6ed-ccfe-4985-96ba-4d78fb84e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.280613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355c6ed-ccfe-4985-96ba-4d78fb84e097 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.280964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355c6ed-ccfe-4985-96ba-4d78fb84e097 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.281249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355c6ed-ccfe-4985-96ba-4d78fb84e097 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.282441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355c6ed-ccfe-4985-96ba-4d78fb84e097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:56.283919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355c6ed-ccfe-4985-96ba-4d78fb84e097 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:56.290015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 38/76] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:56.290856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355c6ed-ccfe-4985-96ba-4d78fb84e097 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.318762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286a689-ef72-44ad-9f02-e27d11b0bb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.319445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286a689-ef72-44ad-9f02-e27d11b0bb4c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.319729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286a689-ef72-44ad-9f02-e27d11b0bb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.320015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286a689-ef72-44ad-9f02-e27d11b0bb4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.382881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286a689-ef72-44ad-9f02-e27d11b0bb4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:56.384331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286a689-ef72-44ad-9f02-e27d11b0bb4c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:56.387660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355c6ed-ccfe-4985-96ba-4d78fb84e097 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.419249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee57b-3a84-48e9-a5ce-11906dfd92f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.420143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee57b-3a84-48e9-a5ce-11906dfd92f4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.420429 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee57b-3a84-48e9-a5ce-11906dfd92f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.420704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee57b-3a84-48e9-a5ce-11906dfd92f4 None admin] PATH_INFO: `/v3/users/0464ce0cc2c244588f440cfed98f23ff` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.421898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee57b-3a84-48e9-a5ce-11906dfd92f4 None admin] RBAC: Authorizing `identity:get_user(user_id=0464ce0cc2c244588f440cfed98f23ff)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:56.423369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee57b-3a84-48e9-a5ce-11906dfd92f4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:56.424988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 39/77] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/users/0464ce0cc2c244588f440cfed98f23ff => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:56.426114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62805dfb-d99b-404f-8efd-ad9e63b96ac1 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.426400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62805dfb-d99b-404f-8efd-ad9e63b96ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.426681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62805dfb-d99b-404f-8efd-ad9e63b96ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.443036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-62805dfb-d99b-404f-8efd-ad9e63b96ac1 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:30:56.444222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-62805dfb-d99b-404f-8efd-ad9e63b96ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:30:56.478796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 39/78] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:30:56.479418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286a689-ef72-44ad-9f02-e27d11b0bb4c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.507279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 40/79] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:30:56.508090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62805dfb-d99b-404f-8efd-ad9e63b96ac1 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.573140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286a689-ef72-44ad-9f02-e27d11b0bb4c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.604592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0641dc-cd6a-4785-a50c-46d6487f0760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.605386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0641dc-cd6a-4785-a50c-46d6487f0760 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.605672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0641dc-cd6a-4785-a50c-46d6487f0760 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.605951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0641dc-cd6a-4785-a50c-46d6487f0760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.606055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62805dfb-d99b-404f-8efd-ad9e63b96ac1 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.616117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0641dc-cd6a-4785-a50c-46d6487f0760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-7d0641dc-cd6a-4785-a50c-46d6487f0760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:30:56.624486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:56.625392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:30:56.626151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 40/80] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:30:56.626874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0641dc-cd6a-4785-a50c-46d6487f0760 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.640477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7038075-ab35-4ceb-9e68-6e2192e0f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.641153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7038075-ab35-4ceb-9e68-6e2192e0f624 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.641436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7038075-ab35-4ceb-9e68-6e2192e0f624 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.641716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7038075-ab35-4ceb-9e68-6e2192e0f624 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.642427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7038075-ab35-4ceb-9e68-6e2192e0f624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:56.643911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7038075-ab35-4ceb-9e68-6e2192e0f624 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:56.669219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 41/81] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:30:56 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:30:56.670036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7038075-ab35-4ceb-9e68-6e2192e0f624 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.731512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0641dc-cd6a-4785-a50c-46d6487f0760 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.769097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dc5b9-5e83-4d95-a73f-7fe6f6a97dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.769776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc5b9-5e83-4d95-a73f-7fe6f6a97dfc None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.770136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc5b9-5e83-4d95-a73f-7fe6f6a97dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.770427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc5b9-5e83-4d95-a73f-7fe6f6a97dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.779559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7038075-ab35-4ceb-9e68-6e2192e0f624 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.816026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce41f1-cb4e-493d-b419-b13c08f1e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.817230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce41f1-cb4e-493d-b419-b13c08f1e47a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.817700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce41f1-cb4e-493d-b419-b13c08f1e47a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.818210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce41f1-cb4e-493d-b419-b13c08f1e47a None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.819750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce41f1-cb4e-493d-b419-b13c08f1e47a None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:56.821453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce41f1-cb4e-493d-b419-b13c08f1e47a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:56.823269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 42/82] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:56.829034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce41f1-cb4e-493d-b419-b13c08f1e47a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.852626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dc5b9-5e83-4d95-a73f-7fe6f6a97dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:56.854108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dc5b9-5e83-4d95-a73f-7fe6f6a97dfc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:56.933422 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce41f1-cb4e-493d-b419-b13c08f1e47a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:56.961585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 41/83] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:30:56.962230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dc5b9-5e83-4d95-a73f-7fe6f6a97dfc None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:56.973329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567be039-04f0-45b5-bd93-1c6a32d8f91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:56.974097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567be039-04f0-45b5-bd93-1c6a32d8f91f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:56.974386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567be039-04f0-45b5-bd93-1c6a32d8f91f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:56.974659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567be039-04f0-45b5-bd93-1c6a32d8f91f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:56.987243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567be039-04f0-45b5-bd93-1c6a32d8f91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-567be039-04f0-45b5-bd93-1c6a32d8f91f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:30:56.995441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:30:56.996297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 43/84] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:30:56.997497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567be039-04f0-45b5-bd93-1c6a32d8f91f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:57.083179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dc5b9-5e83-4d95-a73f-7fe6f6a97dfc None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.118544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.119379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.119734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.120076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.120896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] RBAC: Adding query filter params (name=member) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:57.121272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.122620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567be039-04f0-45b5-bd93-1c6a32d8f91f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.122739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.133432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 42/85] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:57.134512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:57.162941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.163901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.164190 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.164471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.165792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] RBAC: Adding query filter params (role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8, user.id=69d5ff830b14457f94f35b938ef50099) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:57.166112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.168047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.176270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 44/86] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:30:56 2022] GET /identity/v3/role_assignments?user.id=69d5ff830b14457f94f35b938ef50099&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:57.177950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:57.311116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49998234-9f16-4964-a088-8942b4736b2c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.353795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32729b53-e381-477a-8356-f30f0f93c5f3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.376333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162680d0-2e9c-403f-9059-ffdafd3e1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.377226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162680d0-2e9c-403f-9059-ffdafd3e1851 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.377515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162680d0-2e9c-403f-9059-ffdafd3e1851 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.377797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162680d0-2e9c-403f-9059-ffdafd3e1851 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.380515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162680d0-2e9c-403f-9059-ffdafd3e1851 None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.381981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162680d0-2e9c-403f-9059-ffdafd3e1851 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.383734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 43/87] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:30:57 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:57.384508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162680d0-2e9c-403f-9059-ffdafd3e1851 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:57.391094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.391776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.392060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.392340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.393101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:57.393411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.394794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.404076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 45/88] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:30:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:57.405475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:57.513394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce067da-b4cb-483f-af15-6b549fdba44e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.517792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162680d0-2e9c-403f-9059-ffdafd3e1851 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.548124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.548903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.549251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.549538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.550457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8, user.id=0464ce0cc2c244588f440cfed98f23ff) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:57.550885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.551952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31d83-60c8-4ff6-b1ab-8a684ae759bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.552430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.552838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31d83-60c8-4ff6-b1ab-8a684ae759bd None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.553127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31d83-60c8-4ff6-b1ab-8a684ae759bd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.553408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31d83-60c8-4ff6-b1ab-8a684ae759bd None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.554634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31d83-60c8-4ff6-b1ab-8a684ae759bd None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.556177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31d83-60c8-4ff6-b1ab-8a684ae759bd None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.558146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 44/89] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:30:57 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:57.558264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 46/90] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:30:57 2022] GET /identity/v3/role_assignments?user.id=0464ce0cc2c244588f440cfed98f23ff&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:57.558596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31d83-60c8-4ff6-b1ab-8a684ae759bd None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:57.564057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:57.668726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31d83-60c8-4ff6-b1ab-8a684ae759bd None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.675348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be019d0-76d3-4304-827b-2140632894cb None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.705132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22696bdb-adb7-4566-8292-4abb29ab2177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.706054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22696bdb-adb7-4566-8292-4abb29ab2177 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.706318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22696bdb-adb7-4566-8292-4abb29ab2177 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.706596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22696bdb-adb7-4566-8292-4abb29ab2177 None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.707891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22696bdb-adb7-4566-8292-4abb29ab2177 None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.709380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22696bdb-adb7-4566-8292-4abb29ab2177 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.711145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 45/91] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:30:57 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:57.716796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22696bdb-adb7-4566-8292-4abb29ab2177 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:57.717444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48be60-6505-4945-ba69-4b2bc963fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.718317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48be60-6505-4945-ba69-4b2bc963fb56 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.718774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48be60-6505-4945-ba69-4b2bc963fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.719241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48be60-6505-4945-ba69-4b2bc963fb56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.791237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48be60-6505-4945-ba69-4b2bc963fb56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.793061 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48be60-6505-4945-ba69-4b2bc963fb56 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.831280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22696bdb-adb7-4566-8292-4abb29ab2177 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:57.891842 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad125-8353-454d-b8f9-f8d2326ff343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:57.892536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad125-8353-454d-b8f9-f8d2326ff343 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:57.892828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad125-8353-454d-b8f9-f8d2326ff343 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:57.893116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ad125-8353-454d-b8f9-f8d2326ff343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:57.963762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ad125-8353-454d-b8f9-f8d2326ff343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:57.965243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ad125-8353-454d-b8f9-f8d2326ff343 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:57.981886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 47/92] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:30:57.988292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48be60-6505-4945-ba69-4b2bc963fb56 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:58.065574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 46/93] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:30:58.071018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad125-8353-454d-b8f9-f8d2326ff343 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:58.168728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ad125-8353-454d-b8f9-f8d2326ff343 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:58.197231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48be60-6505-4945-ba69-4b2bc963fb56 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:58.203765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a033-453f-4624-9416-8a1047d915ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:58.204631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a033-453f-4624-9416-8a1047d915ea None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:58.204922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a033-453f-4624-9416-8a1047d915ea None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:58.205200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a033-453f-4624-9416-8a1047d915ea None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:58.206415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a033-453f-4624-9416-8a1047d915ea None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:58.207918 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a033-453f-4624-9416-8a1047d915ea None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:58.209609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 47/94] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:30:58 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:58.215262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a033-453f-4624-9416-8a1047d915ea None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:58.259170 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c1d13-8a13-4a5c-9dcb-47c2b6882941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:58.260378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1d13-8a13-4a5c-9dcb-47c2b6882941 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:58.260897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1d13-8a13-4a5c-9dcb-47c2b6882941 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:58.261377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1d13-8a13-4a5c-9dcb-47c2b6882941 None admin] PATH_INFO: `/v3/projects/daf96d762cab40b8b44b44a7ed12f171` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:58.267815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c1d13-8a13-4a5c-9dcb-47c2b6882941 None admin] RBAC: Authorizing `identity:get_project(project_id=daf96d762cab40b8b44b44a7ed12f171)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:58.269563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c1d13-8a13-4a5c-9dcb-47c2b6882941 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:58.271531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 48/95] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:30:57 2022] GET /identity/v3/projects/daf96d762cab40b8b44b44a7ed12f171 => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:58.280157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c1d13-8a13-4a5c-9dcb-47c2b6882941 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:30:58.315327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a033-453f-4624-9416-8a1047d915ea None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:58.363711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77735931-ca14-44d7-ab72-ec65eb33460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:58.364393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735931-ca14-44d7-ab72-ec65eb33460d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:58.364685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735931-ca14-44d7-ab72-ec65eb33460d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:58.364968 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735931-ca14-44d7-ab72-ec65eb33460d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:58.365826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77735931-ca14-44d7-ab72-ec65eb33460d None admin] RBAC: Adding query filter params (role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8, user.id=69d5ff830b14457f94f35b938ef50099) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:58.366145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77735931-ca14-44d7-ab72-ec65eb33460d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:58.367617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77735931-ca14-44d7-ab72-ec65eb33460d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:58.388629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 48/96] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:30:58 2022] GET /identity/v3/role_assignments?user.id=69d5ff830b14457f94f35b938ef50099&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=a3a8307844964e028f49d8bcff278ded => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:30:58.465780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c1d13-8a13-4a5c-9dcb-47c2b6882941 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:30:58.506580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb5734-4fcd-412a-80bc-cdf49f4e8e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:30:58.507291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb5734-4fcd-412a-80bc-cdf49f4e8e94 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:58.507586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb5734-4fcd-412a-80bc-cdf49f4e8e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:58.507865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb5734-4fcd-412a-80bc-cdf49f4e8e94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:30:58.508725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb5734-4fcd-412a-80bc-cdf49f4e8e94 None admin] RBAC: Adding query filter params (role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=daf96d762cab40b8b44b44a7ed12f171, user.id=69d5ff830b14457f94f35b938ef50099) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:30:58.509044 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb5734-4fcd-412a-80bc-cdf49f4e8e94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:30:58.510508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb5734-4fcd-412a-80bc-cdf49f4e8e94 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:30:58.516947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 49/97] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:30:58 2022] GET /identity/v3/role_assignments?user.id=69d5ff830b14457f94f35b938ef50099&scope.project.id=daf96d762cab40b8b44b44a7ed12f171&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:30:59.997833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976dc0-9171-44d1-aca8-dc1f33ff7527 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:30:59.998410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976dc0-9171-44d1-aca8-dc1f33ff7527 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:30:59.998483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976dc0-9171-44d1-aca8-dc1f33ff7527 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.000004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 49/98] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:00.005293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf24f21-7b8e-456d-8ecf-6efc6c3765c5 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.005682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf24f21-7b8e-456d-8ecf-6efc6c3765c5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.005844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf24f21-7b8e-456d-8ecf-6efc6c3765c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.023750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ecf24f21-7b8e-456d-8ecf-6efc6c3765c5 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:00.024940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ecf24f21-7b8e-456d-8ecf-6efc6c3765c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:00.104288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20eaf-6f07-42f9-98a4-f7d45d8d5772 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.104596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20eaf-6f07-42f9-98a4-f7d45d8d5772 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.104874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20eaf-6f07-42f9-98a4-f7d45d8d5772 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.106335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 50/99] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:00.112978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 50/100] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:00.124363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17338-296a-4fb1-9231-ce35af7ea46a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.124660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17338-296a-4fb1-9231-ce35af7ea46a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.124948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17338-296a-4fb1-9231-ce35af7ea46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.146236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf24f21-7b8e-456d-8ecf-6efc6c3765c5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:00.149189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-98f17338-296a-4fb1-9231-ce35af7ea46a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:00.150417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-98f17338-296a-4fb1-9231-ce35af7ea46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:00.265242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 51/101] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:00.290910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf24f21-7b8e-456d-8ecf-6efc6c3765c5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:00.299776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17338-296a-4fb1-9231-ce35af7ea46a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:00.335250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01f2b-0a49-4733-af32-2baa1fd21ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:00.336051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01f2b-0a49-4733-af32-2baa1fd21ede None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.336341 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01f2b-0a49-4733-af32-2baa1fd21ede None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.336623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01f2b-0a49-4733-af32-2baa1fd21ede None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.343894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab01f2b-0a49-4733-af32-2baa1fd21ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:00.345409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab01f2b-0a49-4733-af32-2baa1fd21ede None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:00.347525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 51/102] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:00.368460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01f2b-0a49-4733-af32-2baa1fd21ede None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:00.415919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17338-296a-4fb1-9231-ce35af7ea46a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:00.450896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf56e1-b078-4e45-aef5-f6f94cf22ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:00.452720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf56e1-b078-4e45-aef5-f6f94cf22ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.453221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf56e1-b078-4e45-aef5-f6f94cf22ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.453685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf56e1-b078-4e45-aef5-f6f94cf22ed4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.466260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf56e1-b078-4e45-aef5-f6f94cf22ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-42cf56e1-b078-4e45-aef5-f6f94cf22ed4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:00.475610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:00.476721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:00.477549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:00.479935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 52/103] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:00.481383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c25d-aa58-48c1-b45d-509a3f7d0e86 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.481885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c25d-aa58-48c1-b45d-509a3f7d0e86 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.482490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c25d-aa58-48c1-b45d-509a3f7d0e86 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.484306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 53/104] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:00.488682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226c25d-aa58-48c1-b45d-509a3f7d0e86 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:00.601999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226c25d-aa58-48c1-b45d-509a3f7d0e86 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:00.620887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01f2b-0a49-4733-af32-2baa1fd21ede None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:00.640002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b2a6e-a098-4a72-93ce-ce22e714610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:00.641293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2a6e-a098-4a72-93ce-ce22e714610d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.641793 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2a6e-a098-4a72-93ce-ce22e714610d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.642260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2a6e-a098-4a72-93ce-ce22e714610d None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.643225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b2a6e-a098-4a72-93ce-ce22e714610d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:00.643892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b2a6e-a098-4a72-93ce-ce22e714610d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:00.645467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b2a6e-a098-4a72-93ce-ce22e714610d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:00.655607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 54/105] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:00.657247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee444db-4e7e-4bb3-a48a-fed6273fca53 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.657730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee444db-4e7e-4bb3-a48a-fed6273fca53 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.658499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee444db-4e7e-4bb3-a48a-fed6273fca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.677972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1ee444db-4e7e-4bb3-a48a-fed6273fca53 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:00.678701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ebf4b-bcd4-4b06-847e-41cfa132dbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:00.679407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ebf4b-bcd4-4b06-847e-41cfa132dbc8 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:00.679695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ebf4b-bcd4-4b06-847e-41cfa132dbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:00.679972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ebf4b-bcd4-4b06-847e-41cfa132dbc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:00.680436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1ee444db-4e7e-4bb3-a48a-fed6273fca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:00.680691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ebf4b-bcd4-4b06-847e-41cfa132dbc8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:00.682166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ebf4b-bcd4-4b06-847e-41cfa132dbc8 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:00.737655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 52/106] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:31:00 2022] POST /identity/v3/projects => generated 302 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:31:00.738542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ebf4b-bcd4-4b06-847e-41cfa132dbc8 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:00.779496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 55/107] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:00.817809 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee444db-4e7e-4bb3-a48a-fed6273fca53 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:00.997281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ebf4b-bcd4-4b06-847e-41cfa132dbc8 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.021114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee444db-4e7e-4bb3-a48a-fed6273fca53 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.046546 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd694e-851e-4b73-a2ac-d97aeb6f1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.048143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd694e-851e-4b73-a2ac-d97aeb6f1944 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.048647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd694e-851e-4b73-a2ac-d97aeb6f1944 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.049109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd694e-851e-4b73-a2ac-d97aeb6f1944 None admin] PATH_INFO: `/v3/users/d05543b47d3d441e8b66997728d43947` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.056895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114f34d-8ad5-4e60-a16e-72d344f94fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.058076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114f34d-8ad5-4e60-a16e-72d344f94fcb None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.058076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114f34d-8ad5-4e60-a16e-72d344f94fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.058241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114f34d-8ad5-4e60-a16e-72d344f94fcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.064837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd694e-851e-4b73-a2ac-d97aeb6f1944 None admin] RBAC: Authorizing `identity:get_user(user_id=d05543b47d3d441e8b66997728d43947)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.066636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd694e-851e-4b73-a2ac-d97aeb6f1944 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.068732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 53/108] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:00 2022] GET /identity/v3/users/d05543b47d3d441e8b66997728d43947 => generated 289 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:01.070174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbea25-0d21-4834-ae9e-b80a39985701 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.070278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114f34d-8ad5-4e60-a16e-72d344f94fcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:01.070758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbea25-0d21-4834-ae9e-b80a39985701 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.071306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbea25-0d21-4834-ae9e-b80a39985701 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.072763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 54/109] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:01.076068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbea25-0d21-4834-ae9e-b80a39985701 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-4114f34d-8ad5-4e60-a16e-72d344f94fcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:01.082912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:01.083797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:01.084563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 56/110] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:01.085985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979c7f-1625-462d-b32f-ef0b4d0d648a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.085985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979c7f-1625-462d-b32f-ef0b4d0d648a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.086269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979c7f-1625-462d-b32f-ef0b4d0d648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.103771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-61979c7f-1625-462d-b32f-ef0b4d0d648a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:01.105270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-61979c7f-1625-462d-b32f-ef0b4d0d648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:01.176718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 57/111] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:01.177717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61979c7f-1625-462d-b32f-ef0b4d0d648a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.188636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbea25-0d21-4834-ae9e-b80a39985701 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.223252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f68e40-06bf-4a25-a177-67f033ee4745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.224454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f68e40-06bf-4a25-a177-67f033ee4745 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.224947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f68e40-06bf-4a25-a177-67f033ee4745 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.225412 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f68e40-06bf-4a25-a177-67f033ee4745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.277520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61979c7f-1625-462d-b32f-ef0b4d0d648a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.294845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f68e40-06bf-4a25-a177-67f033ee4745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.297163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f68e40-06bf-4a25-a177-67f033ee4745 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.312672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.313189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.313469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.313756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.314555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] RBAC: Adding query filter params (name=member) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:01.314823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.316351 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.324915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 58/112] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:01.325568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.398898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 55/113] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:01.400096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f68e40-06bf-4a25-a177-67f033ee4745 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.430123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dbf2-6ae0-4f63-8daf-a3d6086f22af None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.467409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bff48-34ba-4c65-b945-3a87cea077c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.467409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bff48-34ba-4c65-b945-3a87cea077c6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.467409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bff48-34ba-4c65-b945-3a87cea077c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.467409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bff48-34ba-4c65-b945-3a87cea077c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.484794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bff48-34ba-4c65-b945-3a87cea077c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-235bff48-34ba-4c65-b945-3a87cea077c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:01.500772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:01.501671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:01.502413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 59/114] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:01.503065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bff48-34ba-4c65-b945-3a87cea077c6 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.511768 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f68e40-06bf-4a25-a177-67f033ee4745 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.547994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c486-c2e9-4663-92c3-009cd41bdc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.549414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c486-c2e9-4663-92c3-009cd41bdc9f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.549896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c486-c2e9-4663-92c3-009cd41bdc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.550379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c486-c2e9-4663-92c3-009cd41bdc9f None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.551848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c486-c2e9-4663-92c3-009cd41bdc9f None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.553631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c486-c2e9-4663-92c3-009cd41bdc9f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.555550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 56/115] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:01.556505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c486-c2e9-4663-92c3-009cd41bdc9f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.613347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bff48-34ba-4c65-b945-3a87cea077c6 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.648619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7585d3-7751-48a8-bb8a-3007387c1efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.649769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7585d3-7751-48a8-bb8a-3007387c1efa None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.649885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7585d3-7751-48a8-bb8a-3007387c1efa None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.650091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7585d3-7751-48a8-bb8a-3007387c1efa None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.651497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7585d3-7751-48a8-bb8a-3007387c1efa None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.653020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7585d3-7751-48a8-bb8a-3007387c1efa None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.655515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 60/116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:01.656175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7585d3-7751-48a8-bb8a-3007387c1efa None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.661716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c486-c2e9-4663-92c3-009cd41bdc9f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.699989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.701043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.701524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.702610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.703730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:01.704227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.705792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.715487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 57/117] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:01.716817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.772169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7585d3-7751-48a8-bb8a-3007387c1efa None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.805856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc99462-1497-482d-8de7-89dc14fe52ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.806650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc99462-1497-482d-8de7-89dc14fe52ba None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.806933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc99462-1497-482d-8de7-89dc14fe52ba None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.807235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc99462-1497-482d-8de7-89dc14fe52ba None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.808437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc99462-1497-482d-8de7-89dc14fe52ba None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.809888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc99462-1497-482d-8de7-89dc14fe52ba None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.811667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 61/118] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:01.812456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc99462-1497-482d-8de7-89dc14fe52ba None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.821783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c524d2e-8234-4452-9e85-9c61bb085b12 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.857702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.859073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.859858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.860334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] RBAC: Adding query filter params (role.id=5fef016fde6f4145b0c37046cd31dc8d, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8, user.id=d05543b47d3d441e8b66997728d43947) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:01.862035 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.864405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.870920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 58/119] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/role_assignments?user.id=d05543b47d3d441e8b66997728d43947&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=5fef016fde6f4145b0c37046cd31dc8d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:01.872180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:01.934328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc99462-1497-482d-8de7-89dc14fe52ba None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:01.977118 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f5ee-6365-4812-8da9-b13eb3e3b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:01.978236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f5ee-6365-4812-8da9-b13eb3e3b35e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.978524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f5ee-6365-4812-8da9-b13eb3e3b35e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.978800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f5ee-6365-4812-8da9-b13eb3e3b35e None admin] PATH_INFO: `/v3/users/0464ce0cc2c244588f440cfed98f23ff` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.980468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4f5ee-6365-4812-8da9-b13eb3e3b35e None admin] RBAC: Authorizing `identity:get_user(user_id=0464ce0cc2c244588f440cfed98f23ff)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:01.982890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4f5ee-6365-4812-8da9-b13eb3e3b35e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:01.985432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 62/120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/users/0464ce0cc2c244588f440cfed98f23ff => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:01.991034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2d223-53de-4eff-a57e-e6c3e6e6f698 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.991034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2d223-53de-4eff-a57e-e6c3e6e6f698 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.991034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2d223-53de-4eff-a57e-e6c3e6e6f698 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.991034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 63/121] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:01.991034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da2d8-a8f3-4746-980b-088460b0a020 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:01.991034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da2d8-a8f3-4746-980b-088460b0a020 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:01.991563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da2d8-a8f3-4746-980b-088460b0a020 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:01.991893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 64/122] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:01.992576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6da2d8-a8f3-4746-980b-088460b0a020 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.011370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143501a-bf68-484e-8fe8-2e440b033d04 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:02.052932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce828e-bab3-4af6-8e77-02575f1c638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:02.054697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce828e-bab3-4af6-8e77-02575f1c638d None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.059557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce828e-bab3-4af6-8e77-02575f1c638d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.059557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce828e-bab3-4af6-8e77-02575f1c638d None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/users/69d5ff830b14457f94f35b938ef50099/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.061202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce828e-bab3-4af6-8e77-02575f1c638d None admin] RBAC: Authorizing `identity:create_grant(project_id=97980c4bfe244a7dbd3d0f26a699c7c8, user_id=69d5ff830b14457f94f35b938ef50099, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:02.062956 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce828e-bab3-4af6-8e77-02575f1c638d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:02.083295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 59/123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:01 2022] PUT /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/users/69d5ff830b14457f94f35b938ef50099/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:02.085560 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85520585-4658-4bf0-98cb-52d7dea393b3 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.086020 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85520585-4658-4bf0-98cb-52d7dea393b3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.087337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85520585-4658-4bf0-98cb-52d7dea393b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.109498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-85520585-4658-4bf0-98cb-52d7dea393b3 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:02.112202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-85520585-4658-4bf0-98cb-52d7dea393b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:02.130061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6da2d8-a8f3-4746-980b-088460b0a020 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:02.177346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db692b1c-8e69-4ad8-9be2-0a96d2498924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:02.178383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db692b1c-8e69-4ad8-9be2-0a96d2498924 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.179125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db692b1c-8e69-4ad8-9be2-0a96d2498924 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.179426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db692b1c-8e69-4ad8-9be2-0a96d2498924 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.180969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db692b1c-8e69-4ad8-9be2-0a96d2498924 None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:02.182869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db692b1c-8e69-4ad8-9be2-0a96d2498924 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:02.184849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 65/124] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:01 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:02.190953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c6440-edc8-48f6-876b-53717cece6f1 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.190953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c6440-edc8-48f6-876b-53717cece6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.190953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c6440-edc8-48f6-876b-53717cece6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.211706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 60/125] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:02.212557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85520585-4658-4bf0-98cb-52d7dea393b3 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.230551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-482c6440-edc8-48f6-876b-53717cece6f1 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:02.234112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-482c6440-edc8-48f6-876b-53717cece6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:02.315788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 66/126] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:02.316593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c6440-edc8-48f6-876b-53717cece6f1 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.370079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85520585-4658-4bf0-98cb-52d7dea393b3 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:02.405748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989b033-90cf-4b8a-965b-81794b601293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:02.407024 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b033-90cf-4b8a-965b-81794b601293 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.407533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b033-90cf-4b8a-965b-81794b601293 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.408024 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989b033-90cf-4b8a-965b-81794b601293 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/users/0464ce0cc2c244588f440cfed98f23ff/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.410374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989b033-90cf-4b8a-965b-81794b601293 None admin] RBAC: Authorizing `identity:create_grant(project_id=97980c4bfe244a7dbd3d0f26a699c7c8, user_id=0464ce0cc2c244588f440cfed98f23ff, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:02.412165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989b033-90cf-4b8a-965b-81794b601293 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:02.427749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 61/127] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:02 2022] PUT /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/users/0464ce0cc2c244588f440cfed98f23ff/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:02.428977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989b033-90cf-4b8a-965b-81794b601293 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.438559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c6440-edc8-48f6-876b-53717cece6f1 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:02.480119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf473ff3-9870-457b-a791-922127903083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:02.481109 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf473ff3-9870-457b-a791-922127903083 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.481396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf473ff3-9870-457b-a791-922127903083 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.481671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf473ff3-9870-457b-a791-922127903083 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.495053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf473ff3-9870-457b-a791-922127903083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-cf473ff3-9870-457b-a791-922127903083 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:02.504601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:02.505580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:02.506365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 67/128] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:02.517717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf473ff3-9870-457b-a791-922127903083 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.576111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989b033-90cf-4b8a-965b-81794b601293 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:02.614191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92d23f-f466-43e2-b387-baa94680a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:02.615414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92d23f-f466-43e2-b387-baa94680a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.615926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92d23f-f466-43e2-b387-baa94680a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.616399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92d23f-f466-43e2-b387-baa94680a7c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.628472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92d23f-f466-43e2-b387-baa94680a7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ba92d23f-f466-43e2-b387-baa94680a7c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:02.637057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:02.638016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:02.639419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:02.641968 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 62/129] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:02.648030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92d23f-f466-43e2-b387-baa94680a7c8 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.663049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf473ff3-9870-457b-a791-922127903083 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:02.752877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:02.753562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.753850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.754130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.754896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:02.755235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:02.756670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:02.766236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 68/130] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:02.771695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.807460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92d23f-f466-43e2-b387-baa94680a7c8 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:02.845477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361051aa-b362-4398-9291-340b6e233349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:02.846241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361051aa-b362-4398-9291-340b6e233349 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.846617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361051aa-b362-4398-9291-340b6e233349 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.847028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361051aa-b362-4398-9291-340b6e233349 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.847899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361051aa-b362-4398-9291-340b6e233349 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:02.848334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361051aa-b362-4398-9291-340b6e233349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:02.849837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361051aa-b362-4398-9291-340b6e233349 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:02.858442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 63/131] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:02.864399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361051aa-b362-4398-9291-340b6e233349 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.899847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eda9c7-9bc6-4245-972e-f13fe101ef97 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:02.941050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3376e5-14e5-4d04-a311-be3780b48a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:02.942267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3376e5-14e5-4d04-a311-be3780b48a14 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:02.942684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3376e5-14e5-4d04-a311-be3780b48a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:02.943175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3376e5-14e5-4d04-a311-be3780b48a14 None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:02.945957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3376e5-14e5-4d04-a311-be3780b48a14 None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:02.947773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3376e5-14e5-4d04-a311-be3780b48a14 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:02.949972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 69/132] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:02 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:02.972544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3376e5-14e5-4d04-a311-be3780b48a14 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:02.972930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361051aa-b362-4398-9291-340b6e233349 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:03.006786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bab31-29ca-43e9-a59c-a38132160f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:03.007707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bab31-29ca-43e9-a59c-a38132160f71 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:03.007994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bab31-29ca-43e9-a59c-a38132160f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:03.008275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bab31-29ca-43e9-a59c-a38132160f71 None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:03.009496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bab31-29ca-43e9-a59c-a38132160f71 None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:03.011082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bab31-29ca-43e9-a59c-a38132160f71 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:03.012761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 64/133] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:02 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:03.018849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bab31-29ca-43e9-a59c-a38132160f71 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:03.117729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bab31-29ca-43e9-a59c-a38132160f71 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:03.118985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3376e5-14e5-4d04-a311-be3780b48a14 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:03.154267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7071616-d5ce-40d8-8a3e-07cb443899f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:03.155353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071616-d5ce-40d8-8a3e-07cb443899f7 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:03.155644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071616-d5ce-40d8-8a3e-07cb443899f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:03.155927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071616-d5ce-40d8-8a3e-07cb443899f7 None admin] PATH_INFO: `/v3/projects/daf96d762cab40b8b44b44a7ed12f171` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:03.157181 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7071616-d5ce-40d8-8a3e-07cb443899f7 None admin] RBAC: Authorizing `identity:get_project(project_id=daf96d762cab40b8b44b44a7ed12f171)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:03.158640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7071616-d5ce-40d8-8a3e-07cb443899f7 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:03.162997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 65/134] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:03 2022] GET /identity/v3/projects/daf96d762cab40b8b44b44a7ed12f171 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:03.173583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7071616-d5ce-40d8-8a3e-07cb443899f7 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:03.196946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8870d9-b808-4518-9987-f91d37dc6f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:03.198412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8870d9-b808-4518-9987-f91d37dc6f41 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:03.198844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8870d9-b808-4518-9987-f91d37dc6f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:03.199304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8870d9-b808-4518-9987-f91d37dc6f41 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:03.200683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8870d9-b808-4518-9987-f91d37dc6f41 None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:03.202856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8870d9-b808-4518-9987-f91d37dc6f41 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:03.207330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 70/135] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:02 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:03.214268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8870d9-b808-4518-9987-f91d37dc6f41 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:03.331836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7071616-d5ce-40d8-8a3e-07cb443899f7 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:03.366000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb94529-bc7b-463f-bf25-3cf7d9565e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:03.367199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb94529-bc7b-463f-bf25-3cf7d9565e10 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:03.367649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb94529-bc7b-463f-bf25-3cf7d9565e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:03.368137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb94529-bc7b-463f-bf25-3cf7d9565e10 None admin] PATH_INFO: `/v3/projects/daf96d762cab40b8b44b44a7ed12f171/users/69d5ff830b14457f94f35b938ef50099/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:03.370320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb94529-bc7b-463f-bf25-3cf7d9565e10 None admin] RBAC: Authorizing `identity:create_grant(project_id=daf96d762cab40b8b44b44a7ed12f171, user_id=69d5ff830b14457f94f35b938ef50099, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:03.371948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb94529-bc7b-463f-bf25-3cf7d9565e10 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:03.392279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 66/136] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:03 2022] PUT /identity/v3/projects/daf96d762cab40b8b44b44a7ed12f171/users/69d5ff830b14457f94f35b938ef50099/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:31:03.416366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8870d9-b808-4518-9987-f91d37dc6f41 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:03.465107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017925d3-803e-49fb-8b7e-2509c53fe365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:03.466012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017925d3-803e-49fb-8b7e-2509c53fe365 None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:03.466293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017925d3-803e-49fb-8b7e-2509c53fe365 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:03.466568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017925d3-803e-49fb-8b7e-2509c53fe365 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/users/69d5ff830b14457f94f35b938ef50099/roles/a3a8307844964e028f49d8bcff278ded` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:03.469848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017925d3-803e-49fb-8b7e-2509c53fe365 None admin] RBAC: Authorizing `identity:create_grant(project_id=97980c4bfe244a7dbd3d0f26a699c7c8, user_id=69d5ff830b14457f94f35b938ef50099, role_id=a3a8307844964e028f49d8bcff278ded)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:03.471332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017925d3-803e-49fb-8b7e-2509c53fe365 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:03.490411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 71/137] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:03 2022] PUT /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/users/69d5ff830b14457f94f35b938ef50099/roles/a3a8307844964e028f49d8bcff278ded => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:04.649027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26b78-7d1f-4f62-9b17-fa08021f9e4c None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:04.649570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26b78-7d1f-4f62-9b17-fa08021f9e4c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:04.649570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26b78-7d1f-4f62-9b17-fa08021f9e4c None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:04.651070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 67/138] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:04.657181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817270c-8e0c-474b-95ec-0f654770a4de None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:04.657631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817270c-8e0c-474b-95ec-0f654770a4de None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:04.657802 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817270c-8e0c-474b-95ec-0f654770a4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:04.679667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5817270c-8e0c-474b-95ec-0f654770a4de None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:04.680866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5817270c-8e0c-474b-95ec-0f654770a4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:04.711015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c0971-ae97-4adc-a10f-d9fb62b26cf3 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:04.711015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c0971-ae97-4adc-a10f-d9fb62b26cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:04.711015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c0971-ae97-4adc-a10f-d9fb62b26cf3 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:04.711817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 68/139] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:04.719124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceac8-cd8d-4eed-8a34-398df68eb426 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:04.719668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceac8-cd8d-4eed-8a34-398df68eb426 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:04.720165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceac8-cd8d-4eed-8a34-398df68eb426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:04.739888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d84ceac8-cd8d-4eed-8a34-398df68eb426 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:04.741416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d84ceac8-cd8d-4eed-8a34-398df68eb426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:04.791886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 72/140] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:04.815387 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 69/141] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:04.837527 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817270c-8e0c-474b-95ec-0f654770a4de None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:04.839354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ceac8-cd8d-4eed-8a34-398df68eb426 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:05.001946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817270c-8e0c-474b-95ec-0f654770a4de None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:05.022589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ceac8-cd8d-4eed-8a34-398df68eb426 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:05.051701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5069e-109a-4b25-a6a0-a889bc149b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:05.052538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5069e-109a-4b25-a6a0-a889bc149b37 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.052829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5069e-109a-4b25-a6a0-a889bc149b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.053109 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5069e-109a-4b25-a6a0-a889bc149b37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.071435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3716a-db41-4718-bb01-f0e2be0f9eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:05.072249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3716a-db41-4718-bb01-f0e2be0f9eec None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.072529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3716a-db41-4718-bb01-f0e2be0f9eec None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.072798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3716a-db41-4718-bb01-f0e2be0f9eec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.076073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5069e-109a-4b25-a6a0-a889bc149b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:05.076260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3716a-db41-4718-bb01-f0e2be0f9eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:05.077789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3716a-db41-4718-bb01-f0e2be0f9eec None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:05.079883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 70/142] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-cef5069e-109a-4b25-a6a0-a889bc149b37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:05.085400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:05.086334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:05.087130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 73/143] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:05.094801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5069e-109a-4b25-a6a0-a889bc149b37 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:05.095081 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3716a-db41-4718-bb01-f0e2be0f9eec None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:05.207022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3716a-db41-4718-bb01-f0e2be0f9eec None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:05.249593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d56d9-14ef-44fd-a8e6-163491041457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:05.250273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d56d9-14ef-44fd-a8e6-163491041457 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.250557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d56d9-14ef-44fd-a8e6-163491041457 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.250832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d56d9-14ef-44fd-a8e6-163491041457 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.251583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d56d9-14ef-44fd-a8e6-163491041457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:05.253099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d56d9-14ef-44fd-a8e6-163491041457 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:05.292554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 71/144] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:05 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:05.305769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5069e-109a-4b25-a6a0-a889bc149b37 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:05.346643 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:05.347357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.347650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.347924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.348691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:05.349001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:05.350425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:05.360283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 74/145] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:05.366502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d56d9-14ef-44fd-a8e6-163491041457 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:05.489160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d56d9-14ef-44fd-a8e6-163491041457 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:05.536186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ac457-ebf3-42e0-bc23-41d38f2c7935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:05.537012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ac457-ebf3-42e0-bc23-41d38f2c7935 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.537307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ac457-ebf3-42e0-bc23-41d38f2c7935 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.537569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ac457-ebf3-42e0-bc23-41d38f2c7935 None admin] PATH_INFO: `/v3/users/d05543b47d3d441e8b66997728d43947` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.538981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ac457-ebf3-42e0-bc23-41d38f2c7935 None admin] RBAC: Authorizing `identity:get_user(user_id=d05543b47d3d441e8b66997728d43947)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:05.540543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ac457-ebf3-42e0-bc23-41d38f2c7935 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:05.542548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 72/146] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:05 2022] GET /identity/v3/users/d05543b47d3d441e8b66997728d43947 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:05.549045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:05.676562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0689c0f-ea1a-4796-9f0c-d426716adb7d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:05.724245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec9d4f-7abb-484c-a519-3f9ec12e70f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:05.725116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec9d4f-7abb-484c-a519-3f9ec12e70f3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.725532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec9d4f-7abb-484c-a519-3f9ec12e70f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.725787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec9d4f-7abb-484c-a519-3f9ec12e70f3 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.731762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec9d4f-7abb-484c-a519-3f9ec12e70f3 None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:05.733336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec9d4f-7abb-484c-a519-3f9ec12e70f3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:05.735359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 75/147] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:05 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:05.741257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ac457-ebf3-42e0-bc23-41d38f2c7935 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:05.799118 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ddc6-71b3-4bdc-90d6-9518c6870756 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.799414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ddc6-71b3-4bdc-90d6-9518c6870756 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.799592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ddc6-71b3-4bdc-90d6-9518c6870756 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.800943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 76/148] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:05.805986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6825-a0c2-4c31-b282-ef3f76adddf9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.806268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6825-a0c2-4c31-b282-ef3f76adddf9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.806547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6825-a0c2-4c31-b282-ef3f76adddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.830785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-deca6825-a0c2-4c31-b282-ef3f76adddf9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:05.831988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-deca6825-a0c2-4c31-b282-ef3f76adddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:05.899526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ac457-ebf3-42e0-bc23-41d38f2c7935 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:05.955631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 77/149] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 10 16:31:05.958087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b82e8-63bc-44db-9f28-fd2fe4c6fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:05.959002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b82e8-63bc-44db-9f28-fd2fe4c6fe0a None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:05.959298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b82e8-63bc-44db-9f28-fd2fe4c6fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:05.959573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b82e8-63bc-44db-9f28-fd2fe4c6fe0a None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/users/d05543b47d3d441e8b66997728d43947/roles/5fef016fde6f4145b0c37046cd31dc8d` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:05.961551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b82e8-63bc-44db-9f28-fd2fe4c6fe0a None admin] RBAC: Authorizing `identity:create_grant(project_id=97980c4bfe244a7dbd3d0f26a699c7c8, user_id=d05543b47d3d441e8b66997728d43947, role_id=5fef016fde6f4145b0c37046cd31dc8d)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:05.963013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b82e8-63bc-44db-9f28-fd2fe4c6fe0a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:05.978866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 73/150] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:05 2022] PUT /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/users/d05543b47d3d441e8b66997728d43947/roles/5fef016fde6f4145b0c37046cd31dc8d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:31:06.000003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6825-a0c2-4c31-b282-ef3f76adddf9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:06.122889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6825-a0c2-4c31-b282-ef3f76adddf9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:06.167122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a7d41-6662-447b-a42e-a3e90601fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:06.167939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a7d41-6662-447b-a42e-a3e90601fd3c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.168221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a7d41-6662-447b-a42e-a3e90601fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.168493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a7d41-6662-447b-a42e-a3e90601fd3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.180207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a7d41-6662-447b-a42e-a3e90601fd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-ae2a7d41-6662-447b-a42e-a3e90601fd3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:06.190990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:06.191924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:06.192702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 78/151] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:06.199437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b82e8-63bc-44db-9f28-fd2fe4c6fe0a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:06.305096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b82e8-63bc-44db-9f28-fd2fe4c6fe0a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:06.340774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d282f-ce11-4c05-a8cc-322e134f1095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:06.341453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d282f-ce11-4c05-a8cc-322e134f1095 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.341764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d282f-ce11-4c05-a8cc-322e134f1095 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.342056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d282f-ce11-4c05-a8cc-322e134f1095 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.342822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d282f-ce11-4c05-a8cc-322e134f1095 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:06.343202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d282f-ce11-4c05-a8cc-322e134f1095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:06.344594 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d282f-ce11-4c05-a8cc-322e134f1095 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:06.354759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 74/152] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:06.360981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a7d41-6662-447b-a42e-a3e90601fd3c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:06.396452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75577-aeb1-4a46-a00a-8b541549e5a3 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.396806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75577-aeb1-4a46-a00a-8b541549e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.396991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75577-aeb1-4a46-a00a-8b541549e5a3 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.398799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 75/153] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:06.409144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e836-b35f-47a9-9ffa-01b153f080bf None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.409442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e836-b35f-47a9-9ffa-01b153f080bf None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.409697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e836-b35f-47a9-9ffa-01b153f080bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.435253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-fd37e836-b35f-47a9-9ffa-01b153f080bf None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:06.437643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fd37e836-b35f-47a9-9ffa-01b153f080bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:06.550656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a7d41-6662-447b-a42e-a3e90601fd3c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:06.553262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 76/154] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:06.608335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbea80-1b47-454e-b389-9d677c6b11b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:06.609225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbea80-1b47-454e-b389-9d677c6b11b5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.609512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbea80-1b47-454e-b389-9d677c6b11b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.609790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbea80-1b47-454e-b389-9d677c6b11b5 None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.615796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbea80-1b47-454e-b389-9d677c6b11b5 None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:06.617291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbea80-1b47-454e-b389-9d677c6b11b5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:06.619099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 79/155] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:06 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:06.620495 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb886c-1d02-47f8-99ca-f6c9d98086ca None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.620780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb886c-1d02-47f8-99ca-f6c9d98086ca None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.621108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb886c-1d02-47f8-99ca-f6c9d98086ca None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.622915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 77/156] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:06.623076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbea80-1b47-454e-b389-9d677c6b11b5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:06.625665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb886c-1d02-47f8-99ca-f6c9d98086ca None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:06.731671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbea80-1b47-454e-b389-9d677c6b11b5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:06.768495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad572d15-9422-4e42-b368-29e73587628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:06.769359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572d15-9422-4e42-b368-29e73587628f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.769901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572d15-9422-4e42-b368-29e73587628f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.770026 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572d15-9422-4e42-b368-29e73587628f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.783511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad572d15-9422-4e42-b368-29e73587628f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-ad572d15-9422-4e42-b368-29e73587628f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:06.794992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:06.796397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 80/157] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:06.797163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b9bf3-e521-4d01-ab89-35c618640399 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.797855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b9bf3-e521-4d01-ab89-35c618640399 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.797855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b9bf3-e521-4d01-ab89-35c618640399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.815916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a31b9bf3-e521-4d01-ab89-35c618640399 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:06.817124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a31b9bf3-e521-4d01-ab89-35c618640399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:06.832718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb886c-1d02-47f8-99ca-f6c9d98086ca None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:06.871256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032eaa-f553-450d-b9f5-dd60cadc3630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:06.872157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032eaa-f553-450d-b9f5-dd60cadc3630 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:06.875573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032eaa-f553-450d-b9f5-dd60cadc3630 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:06.876067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032eaa-f553-450d-b9f5-dd60cadc3630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:06.889467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 81/158] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:06.890694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b9bf3-e521-4d01-ab89-35c618640399 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:06.950493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72032eaa-f553-450d-b9f5-dd60cadc3630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:06.952924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72032eaa-f553-450d-b9f5-dd60cadc3630 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:06.994911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b9bf3-e521-4d01-ab89-35c618640399 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.030360 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.031253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.031634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.032007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.032950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:07.033274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.034753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.043921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 82/159] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:07.045534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.058916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 78/160] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:07.062575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032eaa-f553-450d-b9f5-dd60cadc3630 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.146281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461296f1-a80c-4f2e-a3a6-d2f306630f7e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.163988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032eaa-f553-450d-b9f5-dd60cadc3630 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.181641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5c5a-ac40-4131-907d-7ba8b0afd732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.182484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5c5a-ac40-4131-907d-7ba8b0afd732 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.182845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5c5a-ac40-4131-907d-7ba8b0afd732 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.183385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5c5a-ac40-4131-907d-7ba8b0afd732 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.193766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df5c5a-ac40-4131-907d-7ba8b0afd732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:07.200447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3400e5-806c-4eee-becb-4d96c547ee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.202097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3400e5-806c-4eee-becb-4d96c547ee59 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.202551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3400e5-806c-4eee-becb-4d96c547ee59 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.203014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3400e5-806c-4eee-becb-4d96c547ee59 None admin] PATH_INFO: `/v3/users/0464ce0cc2c244588f440cfed98f23ff` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-24df5c5a-ac40-4131-907d-7ba8b0afd732 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:07.203115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:07.204162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 83/161] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:07.205036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5c5a-ac40-4131-907d-7ba8b0afd732 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.207241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3400e5-806c-4eee-becb-4d96c547ee59 None admin] RBAC: Authorizing `identity:get_user(user_id=0464ce0cc2c244588f440cfed98f23ff)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.208890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3400e5-806c-4eee-becb-4d96c547ee59 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.210720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 79/162] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/users/0464ce0cc2c244588f440cfed98f23ff => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:07.215881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3400e5-806c-4eee-becb-4d96c547ee59 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.307372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5c5a-ac40-4131-907d-7ba8b0afd732 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.319523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3400e5-806c-4eee-becb-4d96c547ee59 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.341525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafcff8-6a9a-4f1a-82ae-beb3fd42b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.343098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafcff8-6a9a-4f1a-82ae-beb3fd42b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.343449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafcff8-6a9a-4f1a-82ae-beb3fd42b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.343792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafcff8-6a9a-4f1a-82ae-beb3fd42b0d3 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.345078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafcff8-6a9a-4f1a-82ae-beb3fd42b0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.346662 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafcff8-6a9a-4f1a-82ae-beb3fd42b0d3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.348390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 84/163] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:07.349236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafcff8-6a9a-4f1a-82ae-beb3fd42b0d3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.357286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221e678-a672-4325-b247-11b27d16e902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.358270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221e678-a672-4325-b247-11b27d16e902 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.358736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221e678-a672-4325-b247-11b27d16e902 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.359206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221e678-a672-4325-b247-11b27d16e902 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.360138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221e678-a672-4325-b247-11b27d16e902 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:07.360616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221e678-a672-4325-b247-11b27d16e902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.362185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221e678-a672-4325-b247-11b27d16e902 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.370693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 80/164] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:07.372271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18210-9cef-4702-9602-47981f4675d8 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.372754 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18210-9cef-4702-9602-47981f4675d8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.373758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18210-9cef-4702-9602-47981f4675d8 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.375487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 81/165] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:07.376485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18210-9cef-4702-9602-47981f4675d8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.451040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafcff8-6a9a-4f1a-82ae-beb3fd42b0d3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.483482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18210-9cef-4702-9602-47981f4675d8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.485401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2133a-2e49-4c9c-a11d-193e3ab281b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.486030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2133a-2e49-4c9c-a11d-193e3ab281b6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.486308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2133a-2e49-4c9c-a11d-193e3ab281b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.486581 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2133a-2e49-4c9c-a11d-193e3ab281b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.519128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.520133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.520643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.521114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.522145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] RBAC: Adding query filter params (role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8, user.id=69d5ff830b14457f94f35b938ef50099) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:07.522652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.524327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.530753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 82/166] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/role_assignments?user.id=69d5ff830b14457f94f35b938ef50099&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:07.531921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.558534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2133a-2e49-4c9c-a11d-193e3ab281b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.559981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2133a-2e49-4c9c-a11d-193e3ab281b6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.640291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ec07-f3b7-405d-b26b-c25394e681f0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.663841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 85/167] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:07.665137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ba3fb-7618-4e9c-a4f0-8d022c26e863 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.665560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ba3fb-7618-4e9c-a4f0-8d022c26e863 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.665736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ba3fb-7618-4e9c-a4f0-8d022c26e863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.676157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabee2a-32d9-4b6a-bcfb-145325fbdaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.677438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabee2a-32d9-4b6a-bcfb-145325fbdaab None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.677923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabee2a-32d9-4b6a-bcfb-145325fbdaab None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.678418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabee2a-32d9-4b6a-bcfb-145325fbdaab None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.679999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabee2a-32d9-4b6a-bcfb-145325fbdaab None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.681783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabee2a-32d9-4b6a-bcfb-145325fbdaab None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.682673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a32ba3fb-7618-4e9c-a4f0-8d022c26e863 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:07.683915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a32ba3fb-7618-4e9c-a4f0-8d022c26e863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:07.684235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 83/168] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:07.685185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabee2a-32d9-4b6a-bcfb-145325fbdaab None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.754160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 86/169] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:07.759175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ba3fb-7618-4e9c-a4f0-8d022c26e863 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.803867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabee2a-32d9-4b6a-bcfb-145325fbdaab None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.839179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5d8c-7d85-42c2-a3dc-1707ccc3231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.840805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5d8c-7d85-42c2-a3dc-1707ccc3231e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.841284 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5d8c-7d85-42c2-a3dc-1707ccc3231e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.841805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5d8c-7d85-42c2-a3dc-1707ccc3231e None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.843245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f5d8c-7d85-42c2-a3dc-1707ccc3231e None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.844932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f5d8c-7d85-42c2-a3dc-1707ccc3231e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.846846 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 84/170] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:07.847861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5d8c-7d85-42c2-a3dc-1707ccc3231e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:07.860326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ba3fb-7618-4e9c-a4f0-8d022c26e863 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.895099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a32a95-b4b7-445c-b1c8-ebe035108419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.895930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32a95-b4b7-445c-b1c8-ebe035108419 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.896114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32a95-b4b7-445c-b1c8-ebe035108419 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:07.896382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32a95-b4b7-445c-b1c8-ebe035108419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:07.956012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5d8c-7d85-42c2-a3dc-1707ccc3231e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:07.987107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a32a95-b4b7-445c-b1c8-ebe035108419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:07.987107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a32a95-b4b7-445c-b1c8-ebe035108419 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:07.996205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051ffaf-323c-44bc-99e1-1a97b124c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:07.997405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ffaf-323c-44bc-99e1-1a97b124c690 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:07.997902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ffaf-323c-44bc-99e1-1a97b124c690 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:08.002999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ffaf-323c-44bc-99e1-1a97b124c690 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:08.027646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051ffaf-323c-44bc-99e1-1a97b124c690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-f051ffaf-323c-44bc-99e1-1a97b124c690 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:08.035587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:08.036466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:08.037509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 85/171] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:08.038168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051ffaf-323c-44bc-99e1-1a97b124c690 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:08.112033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 87/172] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:08.112632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a32a95-b4b7-445c-b1c8-ebe035108419 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:08.193476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051ffaf-323c-44bc-99e1-1a97b124c690 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:08.211777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a32a95-b4b7-445c-b1c8-ebe035108419 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:08.243735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:08.244361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:08.244697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:08.244915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:08.245768 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8, user.id=0464ce0cc2c244588f440cfed98f23ff) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:08.246080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:08.246614 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:08.247315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:08.247591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:08.247689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:08.247859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:08.248682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:08.248984 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:08.250391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:08.254350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 86/173] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:08 2022] GET /identity/v3/role_assignments?user.id=0464ce0cc2c244588f440cfed98f23ff&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:08.255248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:08.260034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 88/174] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:08.265931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:08.374571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d22d1-3958-44f5-9245-3d547b0bc3d0 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:08.399237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507fae-9abe-4e09-b753-18794c9e2b55 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:08.422102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa2c8-b870-44dd-baa6-e54de9e8c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:08.423067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa2c8-b870-44dd-baa6-e54de9e8c029 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:08.423332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa2c8-b870-44dd-baa6-e54de9e8c029 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:08.423610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa2c8-b870-44dd-baa6-e54de9e8c029 None admin] PATH_INFO: `/v3/users/69d5ff830b14457f94f35b938ef50099` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:08.424912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfa2c8-b870-44dd-baa6-e54de9e8c029 None admin] RBAC: Authorizing `identity:get_user(user_id=69d5ff830b14457f94f35b938ef50099)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:08.426397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfa2c8-b870-44dd-baa6-e54de9e8c029 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:08.428487 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 89/175] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:08 2022] GET /identity/v3/users/69d5ff830b14457f94f35b938ef50099 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:08.434729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa2c8-b870-44dd-baa6-e54de9e8c029 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:08.447704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef79189-1d39-4fca-9fe4-7396eea7fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:08.448580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef79189-1d39-4fca-9fe4-7396eea7fa5c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:08.448856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef79189-1d39-4fca-9fe4-7396eea7fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:08.449140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef79189-1d39-4fca-9fe4-7396eea7fa5c None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:08.452279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef79189-1d39-4fca-9fe4-7396eea7fa5c None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:08.453779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef79189-1d39-4fca-9fe4-7396eea7fa5c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:08.455995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 87/176] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:08 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:08.462748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef79189-1d39-4fca-9fe4-7396eea7fa5c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:08.614948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa2c8-b870-44dd-baa6-e54de9e8c029 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:08.674037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fccba-e18a-4403-bf65-fc995aff66b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:08.674694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fccba-e18a-4403-bf65-fc995aff66b0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:08.674994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fccba-e18a-4403-bf65-fc995aff66b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:08.675288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fccba-e18a-4403-bf65-fc995aff66b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:08.691704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef79189-1d39-4fca-9fe4-7396eea7fa5c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:08.752734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:08.753397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:08.753679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:08.753955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:08.754796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] RBAC: Adding query filter params (role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8, user.id=69d5ff830b14457f94f35b938ef50099) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:08.755135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:08.756609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:08.767073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 88/177] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:08 2022] GET /identity/v3/role_assignments?user.id=69d5ff830b14457f94f35b938ef50099&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=a3a8307844964e028f49d8bcff278ded => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:08.791160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fccba-e18a-4403-bf65-fc995aff66b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:08.792720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fccba-e18a-4403-bf65-fc995aff66b0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:08.916073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 90/178] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:31:08.921013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:09.033931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d1aa-13af-4010-a1db-150081cc7df0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:09.069188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90826955-6849-426a-819a-77578af5b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:09.070070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90826955-6849-426a-819a-77578af5b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:09.070354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90826955-6849-426a-819a-77578af5b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:09.070631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90826955-6849-426a-819a-77578af5b6c3 None admin] PATH_INFO: `/v3/projects/daf96d762cab40b8b44b44a7ed12f171` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:09.071903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90826955-6849-426a-819a-77578af5b6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=daf96d762cab40b8b44b44a7ed12f171)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:09.073368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90826955-6849-426a-819a-77578af5b6c3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:09.075288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 89/179] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:08 2022] GET /identity/v3/projects/daf96d762cab40b8b44b44a7ed12f171 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:09.081757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fccba-e18a-4403-bf65-fc995aff66b0 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:09.192695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fccba-e18a-4403-bf65-fc995aff66b0 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:09.240108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d4b17-e861-4a17-8f56-4e64d9ef2aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:09.240782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d4b17-e861-4a17-8f56-4e64d9ef2aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:09.241066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d4b17-e861-4a17-8f56-4e64d9ef2aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:09.241342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d4b17-e861-4a17-8f56-4e64d9ef2aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:09.242201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d4b17-e861-4a17-8f56-4e64d9ef2aa3 None admin] RBAC: Adding query filter params (role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=daf96d762cab40b8b44b44a7ed12f171, user.id=69d5ff830b14457f94f35b938ef50099) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:09.242514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d4b17-e861-4a17-8f56-4e64d9ef2aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:09.244037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d4b17-e861-4a17-8f56-4e64d9ef2aa3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:09.254321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 91/180] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:09 2022] GET /identity/v3/role_assignments?user.id=69d5ff830b14457f94f35b938ef50099&scope.project.id=daf96d762cab40b8b44b44a7ed12f171&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:10.056799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f082c81-6e72-4af3-b2f6-df9cac313af3 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.057867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f082c81-6e72-4af3-b2f6-df9cac313af3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.058473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f082c81-6e72-4af3-b2f6-df9cac313af3 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.060776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 90/181] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:10.068408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190a44-bac4-4791-8382-1b0c91112619 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.069332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190a44-bac4-4791-8382-1b0c91112619 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.069813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190a44-bac4-4791-8382-1b0c91112619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.082886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d7ac0-b387-45ef-b22f-1cd9eeee6d2b None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.083532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d7ac0-b387-45ef-b22f-1cd9eeee6d2b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.084029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d7ac0-b387-45ef-b22f-1cd9eeee6d2b None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.085870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 91/182] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:10.089754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ab190a44-bac4-4791-8382-1b0c91112619 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:10.091160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ab190a44-bac4-4791-8382-1b0c91112619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:10.092353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734adb23-a564-4d15-a7c1-123fdc195480 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.092842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734adb23-a564-4d15-a7c1-123fdc195480 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.093312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734adb23-a564-4d15-a7c1-123fdc195480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.111967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-734adb23-a564-4d15-a7c1-123fdc195480 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:10.113511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-734adb23-a564-4d15-a7c1-123fdc195480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:10.183644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 92/183] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:10.193552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 92/184] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:10.208923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190a44-bac4-4791-8382-1b0c91112619 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.216828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734adb23-a564-4d15-a7c1-123fdc195480 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.318051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190a44-bac4-4791-8382-1b0c91112619 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:10.326628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734adb23-a564-4d15-a7c1-123fdc195480 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:10.360258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd539ec-c07c-48f6-8360-d68ff5410edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:10.361174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd539ec-c07c-48f6-8360-d68ff5410edd None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.361561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd539ec-c07c-48f6-8360-d68ff5410edd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.361950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd539ec-c07c-48f6-8360-d68ff5410edd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.364791 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faebb07-39d2-435d-8882-91ccee90e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:10.365597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebb07-39d2-435d-8882-91ccee90e510 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.365872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebb07-39d2-435d-8882-91ccee90e510 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.366140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebb07-39d2-435d-8882-91ccee90e510 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.372830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd539ec-c07c-48f6-8360-d68ff5410edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:10.376448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faebb07-39d2-435d-8882-91ccee90e510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-6fd539ec-c07c-48f6-8360-d68ff5410edd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:10.380675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:10.381565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:10.382337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 93/185] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-6faebb07-39d2-435d-8882-91ccee90e510 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:10.384507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:10.387112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:10.389188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 93/186] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:10.391077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574546-e25b-449b-94c0-c2c28d2ecf88 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.391077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574546-e25b-449b-94c0-c2c28d2ecf88 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.391077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574546-e25b-449b-94c0-c2c28d2ecf88 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.395195 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faebb07-39d2-435d-8882-91ccee90e510 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.395342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 94/187] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:10.395342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574546-e25b-449b-94c0-c2c28d2ecf88 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.495279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faebb07-39d2-435d-8882-91ccee90e510 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:10.504475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574546-e25b-449b-94c0-c2c28d2ecf88 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:10.525864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94364398-01a5-4e01-90a1-bfb89c58b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:10.526528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364398-01a5-4e01-90a1-bfb89c58b220 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.526805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364398-01a5-4e01-90a1-bfb89c58b220 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.527121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364398-01a5-4e01-90a1-bfb89c58b220 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.527871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94364398-01a5-4e01-90a1-bfb89c58b220 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:10.528179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94364398-01a5-4e01-90a1-bfb89c58b220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:10.530096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94364398-01a5-4e01-90a1-bfb89c58b220 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:10.536160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653afc85-1e41-4d01-8a0c-4e404473f453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:10.536815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653afc85-1e41-4d01-8a0c-4e404473f453 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.537097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653afc85-1e41-4d01-8a0c-4e404473f453 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.537371 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653afc85-1e41-4d01-8a0c-4e404473f453 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.537746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 94/188] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:10.542287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653afc85-1e41-4d01-8a0c-4e404473f453 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:10.542287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653afc85-1e41-4d01-8a0c-4e404473f453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:10.542440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a07b-d066-4f02-9436-c7957259b5e0 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.542440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a07b-d066-4f02-9436-c7957259b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.542440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018a07b-d066-4f02-9436-c7957259b5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.542671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653afc85-1e41-4d01-8a0c-4e404473f453 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:10.555218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 95/189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:10.555218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5979-0ab1-4e28-b466-3fe8419b409a None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.555218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5979-0ab1-4e28-b466-3fe8419b409a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.555218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5979-0ab1-4e28-b466-3fe8419b409a None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.555218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 96/190] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:10.555218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c5979-0ab1-4e28-b466-3fe8419b409a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.559980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5018a07b-d066-4f02-9436-c7957259b5e0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:10.561208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5018a07b-d066-4f02-9436-c7957259b5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:10.623198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 95/191] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:10.624016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018a07b-d066-4f02-9436-c7957259b5e0 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.649832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c5979-0ab1-4e28-b466-3fe8419b409a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:10.682522 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1969b-f843-4544-be95-efcfda07dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:10.683441 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1969b-f843-4544-be95-efcfda07dacc None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.683716 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1969b-f843-4544-be95-efcfda07dacc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.683982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1969b-f843-4544-be95-efcfda07dacc None admin] PATH_INFO: `/v3/users/d05543b47d3d441e8b66997728d43947` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.685148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1969b-f843-4544-be95-efcfda07dacc None admin] RBAC: Authorizing `identity:get_user(user_id=d05543b47d3d441e8b66997728d43947)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:10.686605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1969b-f843-4544-be95-efcfda07dacc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:10.688237 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 97/192] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/users/d05543b47d3d441e8b66997728d43947 => generated 289 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:10.692239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fc8a-6ea5-48cc-a612-c9da99648fd8 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.692709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fc8a-6ea5-48cc-a612-c9da99648fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.692823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fc8a-6ea5-48cc-a612-c9da99648fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.708557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5a53fc8a-6ea5-48cc-a612-c9da99648fd8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:10.709718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5a53fc8a-6ea5-48cc-a612-c9da99648fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:10.717497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018a07b-d066-4f02-9436-c7957259b5e0 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:10.748835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6f19-5604-4a99-9a14-d58a0b51d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:10.749635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6f19-5604-4a99-9a14-d58a0b51d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.749915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6f19-5604-4a99-9a14-d58a0b51d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.750184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f6f19-5604-4a99-9a14-d58a0b51d9e3 None admin] PATH_INFO: `/v3/users/68a5175e5a454f3fb2b202145138a65e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.762462 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f6f19-5604-4a99-9a14-d58a0b51d9e3 None admin] RBAC: Authorizing `identity:get_user(user_id=68a5175e5a454f3fb2b202145138a65e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:10.764471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f6f19-5604-4a99-9a14-d58a0b51d9e3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:10.766111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 96/193] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/users/68a5175e5a454f3fb2b202145138a65e => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:10.767873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6f19-5604-4a99-9a14-d58a0b51d9e3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.771866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 98/194] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:10.772688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53fc8a-6ea5-48cc-a612-c9da99648fd8 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.863460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f6f19-5604-4a99-9a14-d58a0b51d9e3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:10.865590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53fc8a-6ea5-48cc-a612-c9da99648fd8 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:10.895355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aa2ac-5d06-4508-ac9a-a06452376ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:10.896148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aa2ac-5d06-4508-ac9a-a06452376ede None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.896424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aa2ac-5d06-4508-ac9a-a06452376ede None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.896694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aa2ac-5d06-4508-ac9a-a06452376ede None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.897838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242aa2ac-5d06-4508-ac9a-a06452376ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:10.899302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242aa2ac-5d06-4508-ac9a-a06452376ede None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:10.900713 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2992944-1740-4bd8-9cb7-477b555703b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:10.901146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 97/195] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:10.901360 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2992944-1740-4bd8-9cb7-477b555703b7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:10.901622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aa2ac-5d06-4508-ac9a-a06452376ede None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:10.901730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2992944-1740-4bd8-9cb7-477b555703b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:10.902009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2992944-1740-4bd8-9cb7-477b555703b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:10.965089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2992944-1740-4bd8-9cb7-477b555703b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:10.966561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2992944-1740-4bd8-9cb7-477b555703b7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:10.993417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aa2ac-5d06-4508-ac9a-a06452376ede None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.024814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4835bc9-03ab-4c98-a654-0439a5c1a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.025389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4835bc9-03ab-4c98-a654-0439a5c1a0cb None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.025673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4835bc9-03ab-4c98-a654-0439a5c1a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.025944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4835bc9-03ab-4c98-a654-0439a5c1a0cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.058073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 99/196] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:11.058885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2992944-1740-4bd8-9cb7-477b555703b7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.089404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4835bc9-03ab-4c98-a654-0439a5c1a0cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:11.090888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4835bc9-03ab-4c98-a654-0439a5c1a0cb None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:11.152943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2992944-1740-4bd8-9cb7-477b555703b7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.183740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 98/197] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:11.183740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4835bc9-03ab-4c98-a654-0439a5c1a0cb None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.188961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965aeda9-d486-404f-9112-ec334144544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.188961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aeda9-d486-404f-9112-ec334144544c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.188961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aeda9-d486-404f-9112-ec334144544c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.188961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aeda9-d486-404f-9112-ec334144544c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.196869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965aeda9-d486-404f-9112-ec334144544c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-965aeda9-d486-404f-9112-ec334144544c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:11.205726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:11.206618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:11.207447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 100/198] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:11.208099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965aeda9-d486-404f-9112-ec334144544c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.280021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4835bc9-03ab-4c98-a654-0439a5c1a0cb None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.300628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965aeda9-d486-404f-9112-ec334144544c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.311521 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a727fb-c3d2-4356-8f39-4db4626d3b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.312180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a727fb-c3d2-4356-8f39-4db4626d3b2e None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.312461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a727fb-c3d2-4356-8f39-4db4626d3b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.312741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a727fb-c3d2-4356-8f39-4db4626d3b2e None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.313437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a727fb-c3d2-4356-8f39-4db4626d3b2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:11.314879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a727fb-c3d2-4356-8f39-4db4626d3b2e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:11.333102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a5717-534d-49ba-b733-ee476811aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.334215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 99/199] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:11 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:11.334389 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5717-534d-49ba-b733-ee476811aa0a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.334604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5717-534d-49ba-b733-ee476811aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.334800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5717-534d-49ba-b733-ee476811aa0a None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.335032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a727fb-c3d2-4356-8f39-4db4626d3b2e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.336346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a5717-534d-49ba-b733-ee476811aa0a None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:11.337504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a5717-534d-49ba-b733-ee476811aa0a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:11.344198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 101/200] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:11 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:11.344198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a5717-534d-49ba-b733-ee476811aa0a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.447023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a727fb-c3d2-4356-8f39-4db4626d3b2e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.457086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a5717-534d-49ba-b733-ee476811aa0a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.483770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84589b61-6ac4-4fa8-b65b-ce2ec813cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.484650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84589b61-6ac4-4fa8-b65b-ce2ec813cc4b None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.484930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84589b61-6ac4-4fa8-b65b-ce2ec813cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.485200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84589b61-6ac4-4fa8-b65b-ce2ec813cc4b None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.486461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84589b61-6ac4-4fa8-b65b-ce2ec813cc4b None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:11.487941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84589b61-6ac4-4fa8-b65b-ce2ec813cc4b None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:11.493388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.494072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.494618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.494618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.494805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 100/201] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:11 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:11.495538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:11.495732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84589b61-6ac4-4fa8-b65b-ce2ec813cc4b None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.495836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:11.497215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:11.507100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 102/202] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:11.508915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.599850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84589b61-6ac4-4fa8-b65b-ce2ec813cc4b None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.624720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a404c-a9e6-4cb2-b59b-5537bf714fac None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.641270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.642452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.642841 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.643170 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.644307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] RBAC: Adding query filter params (role.id=5fef016fde6f4145b0c37046cd31dc8d, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8, user.id=d05543b47d3d441e8b66997728d43947) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:11.644622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:11.649440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:11.652822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 101/203] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:11 2022] GET /identity/v3/role_assignments?user.id=d05543b47d3d441e8b66997728d43947&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=5fef016fde6f4145b0c37046cd31dc8d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:11.653521 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.674337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.675048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.675338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.675612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.676488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a, user.id=68a5175e5a454f3fb2b202145138a65e) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:11.676802 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:11.678317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:11.684909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 103/204] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:11 2022] GET /identity/v3/role_assignments?user.id=68a5175e5a454f3fb2b202145138a65e&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:11.773082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c86c-a97d-45fa-9475-7ca611a14c0a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.814174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bac0c-f88e-4ad1-b964-d3bda95f4442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.815132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bac0c-f88e-4ad1-b964-d3bda95f4442 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.815913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bac0c-f88e-4ad1-b964-d3bda95f4442 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bac0c-f88e-4ad1-b964-d3bda95f4442 None admin] PATH_INFO: `/v3/users/68a5175e5a454f3fb2b202145138a65e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:11.817615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bac0c-f88e-4ad1-b964-d3bda95f4442 None admin] RBAC: Authorizing `identity:get_user(user_id=68a5175e5a454f3fb2b202145138a65e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:11.819183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bac0c-f88e-4ad1-b964-d3bda95f4442 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:11.826185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 102/205] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:11 2022] GET /identity/v3/users/68a5175e5a454f3fb2b202145138a65e => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:11.828092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:11.952922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060cfe5-06ff-4b34-b9ac-9051ecfd2b97 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:11.986630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425fc69-d467-4569-8b7f-e43e0ede5c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:11.987317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425fc69-d467-4569-8b7f-e43e0ede5c7e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:11.987599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425fc69-d467-4569-8b7f-e43e0ede5c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:11.987871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425fc69-d467-4569-8b7f-e43e0ede5c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:12.057398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425fc69-d467-4569-8b7f-e43e0ede5c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:12.058868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425fc69-d467-4569-8b7f-e43e0ede5c7e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:12.159252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 104/206] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:12.165448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bac0c-f88e-4ad1-b964-d3bda95f4442 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:12.272468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bac0c-f88e-4ad1-b964-d3bda95f4442 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:12.309992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b273-1bab-43f8-92c1-d677d0393dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:12.311279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b273-1bab-43f8-92c1-d677d0393dcb None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:12.311781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b273-1bab-43f8-92c1-d677d0393dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:12.312265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b273-1bab-43f8-92c1-d677d0393dcb None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:12.313647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95b273-1bab-43f8-92c1-d677d0393dcb None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:12.315348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95b273-1bab-43f8-92c1-d677d0393dcb None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:12.317589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 103/207] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:12 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:12.322948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425fc69-d467-4569-8b7f-e43e0ede5c7e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:12.433280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425fc69-d467-4569-8b7f-e43e0ede5c7e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:12.468266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a887eb-48f2-479f-9762-8cedde94bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:12.469266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a887eb-48f2-479f-9762-8cedde94bd8d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:12.469761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a887eb-48f2-479f-9762-8cedde94bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:12.470247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a887eb-48f2-479f-9762-8cedde94bd8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:12.471335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a887eb-48f2-479f-9762-8cedde94bd8d None admin] RBAC: Adding query filter params (role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a, user.id=68a5175e5a454f3fb2b202145138a65e) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:12.471848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a887eb-48f2-479f-9762-8cedde94bd8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:12.473478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a887eb-48f2-479f-9762-8cedde94bd8d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:12.479636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 105/208] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:12 2022] GET /identity/v3/role_assignments?user.id=68a5175e5a454f3fb2b202145138a65e&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=a3a8307844964e028f49d8bcff278ded => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:13.782201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38fb5-ea7d-49b0-af89-5a00bffc82c5 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:13.782724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38fb5-ea7d-49b0-af89-5a00bffc82c5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:13.782724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd38fb5-ea7d-49b0-af89-5a00bffc82c5 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:13.784334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 104/209] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:13.789530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c415e2-19cb-4ed1-9e03-a727fd822b53 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:13.789946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c415e2-19cb-4ed1-9e03-a727fd822b53 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:13.790117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c415e2-19cb-4ed1-9e03-a727fd822b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:13.808151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-83c415e2-19cb-4ed1-9e03-a727fd822b53 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:13.809384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-83c415e2-19cb-4ed1-9e03-a727fd822b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:13.892367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 106/210] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:13.916219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd38fb5-ea7d-49b0-af89-5a00bffc82c5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:13.939115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105cd68-1cbc-4513-8365-153d12c56fa4 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:13.939715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105cd68-1cbc-4513-8365-153d12c56fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:13.940306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105cd68-1cbc-4513-8365-153d12c56fa4 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:13.941883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 107/211] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:13.947074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225dee0-b323-4194-ac55-bc4aca50fae2 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:13.947579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225dee0-b323-4194-ac55-bc4aca50fae2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:13.948083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225dee0-b323-4194-ac55-bc4aca50fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:13.968989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3225dee0-b323-4194-ac55-bc4aca50fae2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:13.970688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3225dee0-b323-4194-ac55-bc4aca50fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:14.030899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd38fb5-ea7d-49b0-af89-5a00bffc82c5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.050235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 108/212] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:14.051415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0082-fcb1-4ade-8fb6-c2092db24bfc None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.051704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0082-fcb1-4ade-8fb6-c2092db24bfc None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.051979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee0082-fcb1-4ade-8fb6-c2092db24bfc None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.053379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 109/213] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:14.059202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251316-6c91-404c-a439-34b625e08260 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.059499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251316-6c91-404c-a439-34b625e08260 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.059782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251316-6c91-404c-a439-34b625e08260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.072473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702200a-8b42-4250-bdc2-4d632c714ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.074046 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702200a-8b42-4250-bdc2-4d632c714ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.074648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702200a-8b42-4250-bdc2-4d632c714ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.075256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702200a-8b42-4250-bdc2-4d632c714ce3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.078610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f2251316-6c91-404c-a439-34b625e08260 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:14.079843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f2251316-6c91-404c-a439-34b625e08260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:14.087248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702200a-8b42-4250-bdc2-4d632c714ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-b702200a-8b42-4250-bdc2-4d632c714ce3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:14.095687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:14.096564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 105/214] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:14.099488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702200a-8b42-4250-bdc2-4d632c714ce3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.153139 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 110/215] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:14.162551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2251316-6c91-404c-a439-34b625e08260 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.196619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702200a-8b42-4250-bdc2-4d632c714ce3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.230687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3178e1-4a4b-49e8-91e3-48343e444a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.231508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3178e1-4a4b-49e8-91e3-48343e444a30 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.231797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3178e1-4a4b-49e8-91e3-48343e444a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.232076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3178e1-4a4b-49e8-91e3-48343e444a30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.233856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3178e1-4a4b-49e8-91e3-48343e444a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:14.235354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3178e1-4a4b-49e8-91e3-48343e444a30 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:14.241664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 106/216] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:14.241664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3178e1-4a4b-49e8-91e3-48343e444a30 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.281525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2251316-6c91-404c-a439-34b625e08260 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.317471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.318363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.318644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.318996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.319754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:14.320061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:14.321423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:14.329409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 111/217] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:14.331823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.342643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3178e1-4a4b-49e8-91e3-48343e444a30 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.380103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6a2e3-c409-4f4d-a365-86fdd7c3fdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.381176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6a2e3-c409-4f4d-a365-86fdd7c3fdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.381463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6a2e3-c409-4f4d-a365-86fdd7c3fdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.381736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6a2e3-c409-4f4d-a365-86fdd7c3fdf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.391551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6a2e3-c409-4f4d-a365-86fdd7c3fdf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-f9e6a2e3-c409-4f4d-a365-86fdd7c3fdf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:14.399360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:14.400252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:14.401281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 107/218] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:14.405312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6a2e3-c409-4f4d-a365-86fdd7c3fdf1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.434363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4567b4-7dd9-40f4-9aba-468485bc16ca None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.468206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9925b-777b-4fef-ac5c-dffc1671cc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.468882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9925b-777b-4fef-ac5c-dffc1671cc62 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.469188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9925b-777b-4fef-ac5c-dffc1671cc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.469447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9925b-777b-4fef-ac5c-dffc1671cc62 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.470163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9925b-777b-4fef-ac5c-dffc1671cc62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:14.471650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9925b-777b-4fef-ac5c-dffc1671cc62 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:14.502992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 112/219] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:14 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:14.502992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9925b-777b-4fef-ac5c-dffc1671cc62 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.506774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6a2e3-c409-4f4d-a365-86fdd7c3fdf1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.544688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b621f4-85d1-488f-8836-92697bf575e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.545615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b621f4-85d1-488f-8836-92697bf575e6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.545896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b621f4-85d1-488f-8836-92697bf575e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.546164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b621f4-85d1-488f-8836-92697bf575e6 None admin] PATH_INFO: `/v3/users/a2b61c9e05fd4892841840ea805bbfd9` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.561441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b621f4-85d1-488f-8836-92697bf575e6 None admin] RBAC: Authorizing `identity:get_user(user_id=a2b61c9e05fd4892841840ea805bbfd9)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:14.562921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b621f4-85d1-488f-8836-92697bf575e6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:14.569500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 108/220] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/users/a2b61c9e05fd4892841840ea805bbfd9 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:14.570416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b621f4-85d1-488f-8836-92697bf575e6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.617795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9925b-777b-4fef-ac5c-dffc1671cc62 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.653778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.655272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.655656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.656136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.657018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:14.657429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:14.659017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:14.668103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 113/221] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:14.674589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.675416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b621f4-85d1-488f-8836-92697bf575e6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.711566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3901800-c41f-4dcd-a30d-22069e2a3fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.712236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3901800-c41f-4dcd-a30d-22069e2a3fea None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.712512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3901800-c41f-4dcd-a30d-22069e2a3fea None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.712783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3901800-c41f-4dcd-a30d-22069e2a3fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.785449 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3901800-c41f-4dcd-a30d-22069e2a3fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:14.787011 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3901800-c41f-4dcd-a30d-22069e2a3fea None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:14.787997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df478e2-9f9c-4404-94b0-41127e5d480e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:14.824336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2c3d7-a45a-458c-a660-1813df153389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:14.826595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2c3d7-a45a-458c-a660-1813df153389 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.827157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2c3d7-a45a-458c-a660-1813df153389 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.827633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2c3d7-a45a-458c-a660-1813df153389 None admin] PATH_INFO: `/v3/users/68a5175e5a454f3fb2b202145138a65e` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.829083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2c3d7-a45a-458c-a660-1813df153389 None admin] RBAC: Authorizing `identity:get_user(user_id=68a5175e5a454f3fb2b202145138a65e)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:14.830723 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2c3d7-a45a-458c-a660-1813df153389 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:14.833031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 114/222] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/users/68a5175e5a454f3fb2b202145138a65e => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:14.834487 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bc277-b411-444a-9781-72808ab8df3d None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.834992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bc277-b411-444a-9781-72808ab8df3d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.835464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bc277-b411-444a-9781-72808ab8df3d None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.837237 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 115/223] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:14.843461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09cc1c-cda7-4b6f-9d7d-96bca85ab173 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:14.844014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09cc1c-cda7-4b6f-9d7d-96bca85ab173 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:14.844438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09cc1c-cda7-4b6f-9d7d-96bca85ab173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:14.863324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3f09cc1c-cda7-4b6f-9d7d-96bca85ab173 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:14.864796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3f09cc1c-cda7-4b6f-9d7d-96bca85ab173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:14.902328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 109/224] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:14.903227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3901800-c41f-4dcd-a30d-22069e2a3fea None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:14.960283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 116/225] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:14.961144 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09cc1c-cda7-4b6f-9d7d-96bca85ab173 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:15.004669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3901800-c41f-4dcd-a30d-22069e2a3fea None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:15.038622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a81ea-da76-46ba-99b5-7dd82cb09510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:15.039540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a81ea-da76-46ba-99b5-7dd82cb09510 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:15.039821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a81ea-da76-46ba-99b5-7dd82cb09510 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:15.040095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a81ea-da76-46ba-99b5-7dd82cb09510 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:15.041286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a81ea-da76-46ba-99b5-7dd82cb09510 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:15.042732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a81ea-da76-46ba-99b5-7dd82cb09510 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:15.044917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 110/226] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:15.045517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a81ea-da76-46ba-99b5-7dd82cb09510 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:15.066619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09cc1c-cda7-4b6f-9d7d-96bca85ab173 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:15.101696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431a84c-4e4b-4ca4-a1d5-a469d6ea9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:15.102908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a84c-4e4b-4ca4-a1d5-a469d6ea9d49 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:15.103430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a84c-4e4b-4ca4-a1d5-a469d6ea9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:15.103892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431a84c-4e4b-4ca4-a1d5-a469d6ea9d49 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:15.105284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431a84c-4e4b-4ca4-a1d5-a469d6ea9d49 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:15.106946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431a84c-4e4b-4ca4-a1d5-a469d6ea9d49 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:15.108890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 117/227] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:14 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:15.109808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431a84c-4e4b-4ca4-a1d5-a469d6ea9d49 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:15.152901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a81ea-da76-46ba-99b5-7dd82cb09510 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:15.187929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f39892-c57d-41ba-8204-3ccc28ee1db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:15.189111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39892-c57d-41ba-8204-3ccc28ee1db9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:15.189583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39892-c57d-41ba-8204-3ccc28ee1db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:15.190060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39892-c57d-41ba-8204-3ccc28ee1db9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:15.200382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f39892-c57d-41ba-8204-3ccc28ee1db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-67f39892-c57d-41ba-8204-3ccc28ee1db9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:15.209672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:15.210593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:15.211420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:15.213775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 111/228] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:15.214749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f39892-c57d-41ba-8204-3ccc28ee1db9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:15.238045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431a84c-4e4b-4ca4-a1d5-a469d6ea9d49 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:15.284129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caad0b-829b-4f8a-86ba-a421bac989a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:15.285023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caad0b-829b-4f8a-86ba-a421bac989a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:15.285302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caad0b-829b-4f8a-86ba-a421bac989a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:15.285574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caad0b-829b-4f8a-86ba-a421bac989a7 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/users/68a5175e5a454f3fb2b202145138a65e/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:15.287582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caad0b-829b-4f8a-86ba-a421bac989a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a, user_id=68a5175e5a454f3fb2b202145138a65e, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:15.289022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caad0b-829b-4f8a-86ba-a421bac989a7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:15.304828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 118/229] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:15 2022] PUT /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/users/68a5175e5a454f3fb2b202145138a65e/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:15.305700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caad0b-829b-4f8a-86ba-a421bac989a7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:15.334366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f39892-c57d-41ba-8204-3ccc28ee1db9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:15.424946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caad0b-829b-4f8a-86ba-a421bac989a7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:15.431693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:15.432374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:15.432657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:15.432937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:15.433785 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] RBAC: Adding query filter params (role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a, user.id=a2b61c9e05fd4892841840ea805bbfd9) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:15.434097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:15.436160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:15.453164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 112/230] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:15 2022] GET /identity/v3/role_assignments?user.id=a2b61c9e05fd4892841840ea805bbfd9&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:15.464559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:15.465314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:15.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:15.465867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:15.466655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:15.466987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:15.468408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:15.477776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 119/231] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:15.484449 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:15.606548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68bfb8-0b15-4c00-adb2-56951c52b23c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:15.645056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87c930-ce6f-4d14-b67a-8db1af89f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:15.646343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87c930-ce6f-4d14-b67a-8db1af89f63c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:15.646841 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87c930-ce6f-4d14-b67a-8db1af89f63c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:15.647349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87c930-ce6f-4d14-b67a-8db1af89f63c None admin] PATH_INFO: `/v3/users/68a5175e5a454f3fb2b202145138a65e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:15.651807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87c930-ce6f-4d14-b67a-8db1af89f63c None admin] RBAC: Authorizing `identity:get_user(user_id=68a5175e5a454f3fb2b202145138a65e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:15.653575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87c930-ce6f-4d14-b67a-8db1af89f63c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:15.656129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 113/232] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:15 2022] GET /identity/v3/users/68a5175e5a454f3fb2b202145138a65e => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:15.661701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:15.788485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0410c9-bc04-4702-ac16-31229e3023fe None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:15.822755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8cc95-de47-4221-9d78-1cf50f5273b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:15.823655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8cc95-de47-4221-9d78-1cf50f5273b6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:15.823938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8cc95-de47-4221-9d78-1cf50f5273b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:15.824215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8cc95-de47-4221-9d78-1cf50f5273b6 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:15.825398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8cc95-de47-4221-9d78-1cf50f5273b6 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:15.826889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8cc95-de47-4221-9d78-1cf50f5273b6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:15.828982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 120/233] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:15 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:15.834239 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87c930-ce6f-4d14-b67a-8db1af89f63c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:15.984868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87c930-ce6f-4d14-b67a-8db1af89f63c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:16.019120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597996c-ddf7-4d58-ba9a-ac717aa08101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:16.020421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597996c-ddf7-4d58-ba9a-ac717aa08101 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:16.020908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597996c-ddf7-4d58-ba9a-ac717aa08101 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:16.021403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597996c-ddf7-4d58-ba9a-ac717aa08101 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/users/68a5175e5a454f3fb2b202145138a65e/roles/a3a8307844964e028f49d8bcff278ded` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:16.024067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597996c-ddf7-4d58-ba9a-ac717aa08101 None admin] RBAC: Authorizing `identity:create_grant(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a, user_id=68a5175e5a454f3fb2b202145138a65e, role_id=a3a8307844964e028f49d8bcff278ded)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:16.025855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597996c-ddf7-4d58-ba9a-ac717aa08101 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:16.048978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 114/234] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:15 2022] PUT /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/users/68a5175e5a454f3fb2b202145138a65e/roles/a3a8307844964e028f49d8bcff278ded => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:17.338008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332fa61-969f-4b4d-8559-0ee1f65d2b08 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:17.338527 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332fa61-969f-4b4d-8559-0ee1f65d2b08 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:17.338603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332fa61-969f-4b4d-8559-0ee1f65d2b08 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:17.340116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 121/235] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:17.356918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32f50-e705-47dd-b21e-2072c7fb0930 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:17.357932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32f50-e705-47dd-b21e-2072c7fb0930 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:17.358072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd32f50-e705-47dd-b21e-2072c7fb0930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:17.371011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5296bb-2742-4926-8f1f-ce3253873ba0 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:17.371312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5296bb-2742-4926-8f1f-ce3253873ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:17.371595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5296bb-2742-4926-8f1f-ce3253873ba0 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:17.372993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 122/236] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:17.376230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-8cd32f50-e705-47dd-b21e-2072c7fb0930 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:17.377551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8cd32f50-e705-47dd-b21e-2072c7fb0930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:17.384117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a448aff-76b7-46f3-bfaf-02c50cb34656 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:17.384579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a448aff-76b7-46f3-bfaf-02c50cb34656 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:17.385026 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a448aff-76b7-46f3-bfaf-02c50cb34656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:17.415912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8a448aff-76b7-46f3-bfaf-02c50cb34656 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:17.417324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8a448aff-76b7-46f3-bfaf-02c50cb34656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:17.445980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 115/237] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:17.475637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd32f50-e705-47dd-b21e-2072c7fb0930 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:17.584234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd32f50-e705-47dd-b21e-2072c7fb0930 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:17.587296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 123/238] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:17.628366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a448aff-76b7-46f3-bfaf-02c50cb34656 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:17.631970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5d8e0-fa30-4bf7-bc76-77782dc8f2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:17.632785 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d8e0-fa30-4bf7-bc76-77782dc8f2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:17.633970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d8e0-fa30-4bf7-bc76-77782dc8f2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:17.634274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d8e0-fa30-4bf7-bc76-77782dc8f2b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:17.635530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5d8e0-fa30-4bf7-bc76-77782dc8f2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:17.637013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5d8e0-fa30-4bf7-bc76-77782dc8f2b4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:17.643619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 116/239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:17.645552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5d8e0-fa30-4bf7-bc76-77782dc8f2b4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:17.784416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5d8e0-fa30-4bf7-bc76-77782dc8f2b4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:17.825234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6a80-6e3d-4ead-8833-c0d1db6d535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:17.825929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6a80-6e3d-4ead-8833-c0d1db6d535c None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:17.826218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6a80-6e3d-4ead-8833-c0d1db6d535c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:17.826493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6a80-6e3d-4ead-8833-c0d1db6d535c None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:17.827227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c6a80-6e3d-4ead-8833-c0d1db6d535c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:17.828678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c6a80-6e3d-4ead-8833-c0d1db6d535c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:17.846469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a448aff-76b7-46f3-bfaf-02c50cb34656 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:17.890870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 117/240] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:17 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:31:17.896203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed903cf-ccf5-4a78-8436-27e6a5b61ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:17.897226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed903cf-ccf5-4a78-8436-27e6a5b61ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:17.897654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed903cf-ccf5-4a78-8436-27e6a5b61ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:17.898091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed903cf-ccf5-4a78-8436-27e6a5b61ee2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:17.916373 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed903cf-ccf5-4a78-8436-27e6a5b61ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-eed903cf-ccf5-4a78-8436-27e6a5b61ee2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:17.925974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:17.927061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:17.928094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:17.934825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 124/241] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:17.936231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6a80-6e3d-4ead-8833-c0d1db6d535c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:18.090581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6a80-6e3d-4ead-8833-c0d1db6d535c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:18.148644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a5ba-a9f6-4ad8-9eb0-39f8c4480d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:18.149260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a5ba-a9f6-4ad8-9eb0-39f8c4480d63 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.149533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a5ba-a9f6-4ad8-9eb0-39f8c4480d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.149858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a5ba-a9f6-4ad8-9eb0-39f8c4480d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.150632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a5ba-a9f6-4ad8-9eb0-39f8c4480d63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:18.150944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a5ba-a9f6-4ad8-9eb0-39f8c4480d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:18.152349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a5ba-a9f6-4ad8-9eb0-39f8c4480d63 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:18.166587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 118/242] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:18.174274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed903cf-ccf5-4a78-8436-27e6a5b61ee2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:18.186870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69041-6aa9-4976-b9e6-1813f4896101 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.187319 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69041-6aa9-4976-b9e6-1813f4896101 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.187598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69041-6aa9-4976-b9e6-1813f4896101 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.189120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 119/243] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:18.194986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb730b7-b330-4150-93fd-26e38b9ebe20 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.195545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb730b7-b330-4150-93fd-26e38b9ebe20 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.195905 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb730b7-b330-4150-93fd-26e38b9ebe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.223872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-9fb730b7-b330-4150-93fd-26e38b9ebe20 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:18.225840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9fb730b7-b330-4150-93fd-26e38b9ebe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:18.309689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 120/244] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:18.315959 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d5621-83a4-4196-96eb-c0296b09cc21 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.316706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d5621-83a4-4196-96eb-c0296b09cc21 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.316706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d5621-83a4-4196-96eb-c0296b09cc21 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.317843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 121/245] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:18.322797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0f79-baf6-4294-91a1-f44419e25b9c None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.323110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0f79-baf6-4294-91a1-f44419e25b9c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.323391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0f79-baf6-4294-91a1-f44419e25b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.343275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-792c0f79-baf6-4294-91a1-f44419e25b9c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:18.344471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-792c0f79-baf6-4294-91a1-f44419e25b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:18.350087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed903cf-ccf5-4a78-8436-27e6a5b61ee2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:18.384403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b2440-d7d8-4086-8c98-fd792e0ea9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:18.385541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2440-d7d8-4086-8c98-fd792e0ea9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.386058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2440-d7d8-4086-8c98-fd792e0ea9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.386471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2440-d7d8-4086-8c98-fd792e0ea9d5 None admin] PATH_INFO: `/v3/users/a6ebc30337ec4b229182ccbfaff67de7` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.404896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b2440-d7d8-4086-8c98-fd792e0ea9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=a6ebc30337ec4b229182ccbfaff67de7)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:18.404896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b2440-d7d8-4086-8c98-fd792e0ea9d5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:18.406594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 125/246] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:18 2022] GET /identity/v3/users/a6ebc30337ec4b229182ccbfaff67de7 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:18.407515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b2440-d7d8-4086-8c98-fd792e0ea9d5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:18.422387 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 122/247] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:18.423037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0f79-baf6-4294-91a1-f44419e25b9c None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:18.520892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b2440-d7d8-4086-8c98-fd792e0ea9d5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:18.541716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0f79-baf6-4294-91a1-f44419e25b9c None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:18.561033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee88908-57de-4c28-bf8a-1f330f099dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:18.562248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88908-57de-4c28-bf8a-1f330f099dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.562741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88908-57de-4c28-bf8a-1f330f099dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.563179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88908-57de-4c28-bf8a-1f330f099dc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.574796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee88908-57de-4c28-bf8a-1f330f099dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:18.582434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbddfc-654a-430d-9ced-5254893a7917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:18.583153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbddfc-654a-430d-9ced-5254893a7917 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.583438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbddfc-654a-430d-9ced-5254893a7917 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.583712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbddfc-654a-430d-9ced-5254893a7917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-8ee88908-57de-4c28-bf8a-1f330f099dc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:18.585387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:18.586275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:18.587148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:18.589271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 126/248] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:18.590282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee88908-57de-4c28-bf8a-1f330f099dc1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:18.668926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbddfc-654a-430d-9ced-5254893a7917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:18.671366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbddfc-654a-430d-9ced-5254893a7917 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:18.703146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee88908-57de-4c28-bf8a-1f330f099dc1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:18.737204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bac8f9-1ee4-4093-88d5-7ff32df7d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:18.738073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac8f9-1ee4-4093-88d5-7ff32df7d129 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.738347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac8f9-1ee4-4093-88d5-7ff32df7d129 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.738626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bac8f9-1ee4-4093-88d5-7ff32df7d129 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.749482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bac8f9-1ee4-4093-88d5-7ff32df7d129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-17bac8f9-1ee4-4093-88d5-7ff32df7d129 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:18.757717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:18.758792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:18.759777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 127/249] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:18.760449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bac8f9-1ee4-4093-88d5-7ff32df7d129 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:18.804257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 123/250] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:18.805811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbddfc-654a-430d-9ced-5254893a7917 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:18.867618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bac8f9-1ee4-4093-88d5-7ff32df7d129 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:18.908830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce0c5e-e305-4d5d-8f18-04c12fee5ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:18.909799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0c5e-e305-4d5d-8f18-04c12fee5ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.910230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0c5e-e305-4d5d-8f18-04c12fee5ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.910660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce0c5e-e305-4d5d-8f18-04c12fee5ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.911626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce0c5e-e305-4d5d-8f18-04c12fee5ac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:18.912116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce0c5e-e305-4d5d-8f18-04c12fee5ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:18.913635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce0c5e-e305-4d5d-8f18-04c12fee5ac6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:18.924222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 128/251] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:18.930044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bb0b2-c7d8-43fa-b1c8-262b00d3c830 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.930563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bb0b2-c7d8-43fa-b1c8-262b00d3c830 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.931097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bb0b2-c7d8-43fa-b1c8-262b00d3c830 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.931996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbddfc-654a-430d-9ced-5254893a7917 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:18.933475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 129/252] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:18.934509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bb0b2-c7d8-43fa-b1c8-262b00d3c830 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:18.978731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:18.979306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:18.979590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:18.979865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:18.980623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:18.980929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:18.983369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:18.993734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 124/253] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:18.994584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:19.046906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bb0b2-c7d8-43fa-b1c8-262b00d3c830 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:19.081041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cfe97-5710-4abf-96fb-271314c8a584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:19.081900 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cfe97-5710-4abf-96fb-271314c8a584 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:19.082182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cfe97-5710-4abf-96fb-271314c8a584 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:19.082456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cfe97-5710-4abf-96fb-271314c8a584 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:19.083668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cfe97-5710-4abf-96fb-271314c8a584 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:19.085107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cfe97-5710-4abf-96fb-271314c8a584 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:19.086807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 130/254] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:18 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:19.087991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9889df-2c9e-49e5-9f36-f811a1bcaaa9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:19.088269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9889df-2c9e-49e5-9f36-f811a1bcaaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:19.088544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9889df-2c9e-49e5-9f36-f811a1bcaaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:19.112823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fa9889df-2c9e-49e5-9f36-f811a1bcaaa9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:19.113513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3a07-b945-4ab2-98b0-d6751223b060 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:19.114026 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fa9889df-2c9e-49e5-9f36-f811a1bcaaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:19.146491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905319f-5338-4654-beaa-e106c2be171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:19.147380 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905319f-5338-4654-beaa-e106c2be171c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:19.147669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905319f-5338-4654-beaa-e106c2be171c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:19.147931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905319f-5338-4654-beaa-e106c2be171c None admin] PATH_INFO: `/v3/users/68a5175e5a454f3fb2b202145138a65e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:19.149165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905319f-5338-4654-beaa-e106c2be171c None admin] RBAC: Authorizing `identity:get_user(user_id=68a5175e5a454f3fb2b202145138a65e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:19.150581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905319f-5338-4654-beaa-e106c2be171c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:19.152543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 125/255] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:18 2022] GET /identity/v3/users/68a5175e5a454f3fb2b202145138a65e => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:19.153318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905319f-5338-4654-beaa-e106c2be171c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:19.195739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 131/256] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:19.199858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9889df-2c9e-49e5-9f36-f811a1bcaaa9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:19.279387 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905319f-5338-4654-beaa-e106c2be171c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:19.318610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9889df-2c9e-49e5-9f36-f811a1bcaaa9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:19.327156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4e57-b046-4c3b-ad4e-7f3ce6cfe115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:19.328411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4e57-b046-4c3b-ad4e-7f3ce6cfe115 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:19.328693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4e57-b046-4c3b-ad4e-7f3ce6cfe115 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:19.328974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4e57-b046-4c3b-ad4e-7f3ce6cfe115 None admin] PATH_INFO: `/v3/users/a2b61c9e05fd4892841840ea805bbfd9` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:19.330743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4e57-b046-4c3b-ad4e-7f3ce6cfe115 None admin] RBAC: Authorizing `identity:get_user(user_id=a2b61c9e05fd4892841840ea805bbfd9)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:19.332793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4e57-b046-4c3b-ad4e-7f3ce6cfe115 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:19.335139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 126/257] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:19 2022] GET /identity/v3/users/a2b61c9e05fd4892841840ea805bbfd9 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:19.336253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4e57-b046-4c3b-ad4e-7f3ce6cfe115 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:19.353205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:19.354059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:19.354438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:19.354810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:19.355789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] RBAC: Adding query filter params (role.id=5fef016fde6f4145b0c37046cd31dc8d, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a, user.id=a6ebc30337ec4b229182ccbfaff67de7) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:19.356200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:19.358367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:19.364428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 132/258] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:19 2022] GET /identity/v3/role_assignments?user.id=a6ebc30337ec4b229182ccbfaff67de7&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=5fef016fde6f4145b0c37046cd31dc8d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:19.365324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:19.466038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4e57-b046-4c3b-ad4e-7f3ce6cfe115 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:19.502435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c6df0-59dd-4951-b7da-db3dbc58d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:19.503138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c6df0-59dd-4951-b7da-db3dbc58d11e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:19.503421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c6df0-59dd-4951-b7da-db3dbc58d11e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:19.503697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c6df0-59dd-4951-b7da-db3dbc58d11e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:19.534727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813aec1-eeb1-40d4-bb10-fea9467c1815 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:19.578740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d496-4550-48b4-86c2-1102ed580cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:19.579845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d496-4550-48b4-86c2-1102ed580cdd None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:19.580887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d496-4550-48b4-86c2-1102ed580cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:19.581318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d496-4550-48b4-86c2-1102ed580cdd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:19.583316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c6df0-59dd-4951-b7da-db3dbc58d11e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:19.584812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c6df0-59dd-4951-b7da-db3dbc58d11e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:19.606238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02d496-4550-48b4-86c2-1102ed580cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-5b02d496-4550-48b4-86c2-1102ed580cdd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:19.620966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:19.622076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:19.622929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:19.628274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 133/259] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:19.629266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d496-4550-48b4-86c2-1102ed580cdd None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:19.780000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d496-4550-48b4-86c2-1102ed580cdd None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:19.809704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 127/260] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:19.810596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c6df0-59dd-4951-b7da-db3dbc58d11e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:19.821150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed497-8365-4728-a2a7-188d84309fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:19.827446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed497-8365-4728-a2a7-188d84309fac None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:19.827862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed497-8365-4728-a2a7-188d84309fac None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:19.828249 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed497-8365-4728-a2a7-188d84309fac None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:19.831691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed497-8365-4728-a2a7-188d84309fac None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:19.833346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed497-8365-4728-a2a7-188d84309fac None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:19.835505 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 134/261] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:19 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:19.837799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed497-8365-4728-a2a7-188d84309fac None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:19.954033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed497-8365-4728-a2a7-188d84309fac None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:20.002303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a7fca-c494-4d74-83d9-2c2175d646d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:20.003213 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a7fca-c494-4d74-83d9-2c2175d646d2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:20.003491 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a7fca-c494-4d74-83d9-2c2175d646d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:20.003757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a7fca-c494-4d74-83d9-2c2175d646d2 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:20.004939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a7fca-c494-4d74-83d9-2c2175d646d2 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:20.006386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a7fca-c494-4d74-83d9-2c2175d646d2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:20.008121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 135/262] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:19 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:20.008847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a7fca-c494-4d74-83d9-2c2175d646d2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:20.035505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c6df0-59dd-4951-b7da-db3dbc58d11e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:20.072320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:20.073133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:20.073419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:20.073820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:20.074586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:20.074893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:20.076871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:20.085812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 128/263] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:20.087018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:20.199969 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0eaa42-b8ca-4750-8b9c-e0d628216506 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:20.217128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a7fca-c494-4d74-83d9-2c2175d646d2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:20.236639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:20.237295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:20.237576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:20.237854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:20.238689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a, user.id=68a5175e5a454f3fb2b202145138a65e) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:20.239025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:20.241064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:20.247464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 129/264] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:20 2022] GET /identity/v3/role_assignments?user.id=68a5175e5a454f3fb2b202145138a65e&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:20.249217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:20.308324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e98fad-e7fc-4cab-a3cf-4dff424158ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:20.309562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98fad-e7fc-4cab-a3cf-4dff424158ec None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:20.310065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98fad-e7fc-4cab-a3cf-4dff424158ec None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:20.311119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e98fad-e7fc-4cab-a3cf-4dff424158ec None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/users/a2b61c9e05fd4892841840ea805bbfd9/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:20.320679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e98fad-e7fc-4cab-a3cf-4dff424158ec None admin] RBAC: Authorizing `identity:create_grant(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a, user_id=a2b61c9e05fd4892841840ea805bbfd9, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:20.322517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e98fad-e7fc-4cab-a3cf-4dff424158ec None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:20.351581 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 136/265] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:20 2022] PUT /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/users/a2b61c9e05fd4892841840ea805bbfd9/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:20.358818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149726d6-c52e-45d5-80da-abdce2329419 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:20.399511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f09d-5347-45c6-9a33-1041bdf5d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:20.400524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f09d-5347-45c6-9a33-1041bdf5d4dd None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:20.400798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f09d-5347-45c6-9a33-1041bdf5d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:20.401072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f09d-5347-45c6-9a33-1041bdf5d4dd None admin] PATH_INFO: `/v3/users/68a5175e5a454f3fb2b202145138a65e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:20.402389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929f09d-5347-45c6-9a33-1041bdf5d4dd None admin] RBAC: Authorizing `identity:get_user(user_id=68a5175e5a454f3fb2b202145138a65e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:20.404232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929f09d-5347-45c6-9a33-1041bdf5d4dd None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:20.406524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 130/266] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:20 2022] GET /identity/v3/users/68a5175e5a454f3fb2b202145138a65e => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:20.412103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e98fad-e7fc-4cab-a3cf-4dff424158ec None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:20.532428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e98fad-e7fc-4cab-a3cf-4dff424158ec None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:20.577860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9d8cd-1168-432e-92d3-3d1ab72303e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:20.578439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d8cd-1168-432e-92d3-3d1ab72303e3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:20.578719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d8cd-1168-432e-92d3-3d1ab72303e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:20.579008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d8cd-1168-432e-92d3-3d1ab72303e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:20.665382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9d8cd-1168-432e-92d3-3d1ab72303e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:20.666855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9d8cd-1168-432e-92d3-3d1ab72303e3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:20.771613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 137/267] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:20.777066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f09d-5347-45c6-9a33-1041bdf5d4dd None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:20.883461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f09d-5347-45c6-9a33-1041bdf5d4dd None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:20.918328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b7d13-9cb6-4231-b053-74ff266b7f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:20.919481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7d13-9cb6-4231-b053-74ff266b7f1f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:20.919848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7d13-9cb6-4231-b053-74ff266b7f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:20.920122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7d13-9cb6-4231-b053-74ff266b7f1f None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:20.921373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b7d13-9cb6-4231-b053-74ff266b7f1f None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:20.922889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b7d13-9cb6-4231-b053-74ff266b7f1f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:20.924933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 131/268] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:20 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:20.930754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9d8cd-1168-432e-92d3-3d1ab72303e3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:21.037162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9d8cd-1168-432e-92d3-3d1ab72303e3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:21.044857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2890110-64b9-4151-9f1f-5e06eb990145 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.045140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2890110-64b9-4151-9f1f-5e06eb990145 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.045411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2890110-64b9-4151-9f1f-5e06eb990145 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.046918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 132/269] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:21.052201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824839-6186-4386-8d36-898f62f1655f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.052745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824839-6186-4386-8d36-898f62f1655f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.053223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824839-6186-4386-8d36-898f62f1655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.071100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-0e824839-6186-4386-8d36-898f62f1655f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:21.072615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-0e824839-6186-4386-8d36-898f62f1655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:21.080456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:21.081561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.081851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.082130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.082992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] RBAC: Adding query filter params (role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a, user.id=68a5175e5a454f3fb2b202145138a65e) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:21.083314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:21.085148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:21.092050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 138/270] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:20 2022] GET /identity/v3/role_assignments?user.id=68a5175e5a454f3fb2b202145138a65e&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=a3a8307844964e028f49d8bcff278ded => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:21.209881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 133/271] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:21.245226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:21.300305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7d9d-0733-4eae-9375-17aa23d99441 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.300938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7d9d-0733-4eae-9375-17aa23d99441 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.301414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7d9d-0733-4eae-9375-17aa23d99441 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.303264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 134/272] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:21.308327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053acf-8815-4d4e-bd8d-7b7327a2d1d2 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.308837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053acf-8815-4d4e-bd8d-7b7327a2d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.309315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053acf-8815-4d4e-bd8d-7b7327a2d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.327867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6a053acf-8815-4d4e-bd8d-7b7327a2d1d2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:21.329434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6a053acf-8815-4d4e-bd8d-7b7327a2d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:21.361805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930766b1-b1d8-48a1-a0d3-ac704190fe19 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:21.404345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8960341-4728-46b9-b79a-805f359b2e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:21.405421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960341-4728-46b9-b79a-805f359b2e03 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.405855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960341-4728-46b9-b79a-805f359b2e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.406141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960341-4728-46b9-b79a-805f359b2e03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.417345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 135/273] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:21.424571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8960341-4728-46b9-b79a-805f359b2e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-c8960341-4728-46b9-b79a-805f359b2e03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:21.432428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:21.433312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:21.434095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 139/274] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:21.448021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8960341-4728-46b9-b79a-805f359b2e03 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:21.448176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a053acf-8815-4d4e-bd8d-7b7327a2d1d2 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:21.563455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a053acf-8815-4d4e-bd8d-7b7327a2d1d2 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:21.578984 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8960341-4728-46b9-b79a-805f359b2e03 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:21.601192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:21.602212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.602699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.604187 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.605173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:21.605709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:21.607898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:21.617009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 136/275] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:21.619794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17488ba-dd76-403e-ace2-14992ada0efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:21.620852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17488ba-dd76-403e-ace2-14992ada0efa None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.621342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17488ba-dd76-403e-ace2-14992ada0efa None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.622646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:21.623418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17488ba-dd76-403e-ace2-14992ada0efa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.626604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17488ba-dd76-403e-ace2-14992ada0efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:21.629011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17488ba-dd76-403e-ace2-14992ada0efa None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:21.630815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 140/276] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:21.637216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17488ba-dd76-403e-ace2-14992ada0efa None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:21.736618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7aaca-9d94-4c12-92f4-adef1581ead6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:21.760595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17488ba-dd76-403e-ace2-14992ada0efa None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:21.777338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6d65-3777-409f-a118-00a0328d6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:21.778222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6d65-3777-409f-a118-00a0328d6db2 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.778758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6d65-3777-409f-a118-00a0328d6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.779094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6d65-3777-409f-a118-00a0328d6db2 None admin] PATH_INFO: `/v3/users/fdea172edc2f40ff915f18d8490ad4b3` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.797686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf6d65-3777-409f-a118-00a0328d6db2 None admin] RBAC: Authorizing `identity:get_user(user_id=fdea172edc2f40ff915f18d8490ad4b3)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:21.799486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf6d65-3777-409f-a118-00a0328d6db2 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:21.803002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 137/277] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:21 2022] GET /identity/v3/users/fdea172edc2f40ff915f18d8490ad4b3 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:21.807372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6d65-3777-409f-a118-00a0328d6db2 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:21.813998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02ea6-aed9-4eca-a52f-97b911f0db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:21.814693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02ea6-aed9-4eca-a52f-97b911f0db96 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.815077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02ea6-aed9-4eca-a52f-97b911f0db96 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.815468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02ea6-aed9-4eca-a52f-97b911f0db96 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.816252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02ea6-aed9-4eca-a52f-97b911f0db96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:21.817818 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02ea6-aed9-4eca-a52f-97b911f0db96 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:21.847195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 141/278] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:21 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:31:21.944488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6d65-3777-409f-a118-00a0328d6db2 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:21.992456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fd64c-acf0-44b7-a41c-cd3f3d7f78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:21.993138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd64c-acf0-44b7-a41c-cd3f3d7f78f4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:21.993419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd64c-acf0-44b7-a41c-cd3f3d7f78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:21.993697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fd64c-acf0-44b7-a41c-cd3f3d7f78f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:21.994559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fd64c-acf0-44b7-a41c-cd3f3d7f78f4 None admin] RBAC: Adding query filter params (role.id=6ec804c74dad4bf8847c06a34d95505a, user.id=fdea172edc2f40ff915f18d8490ad4b3, scope.system=all) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:21.994872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fd64c-acf0-44b7-a41c-cd3f3d7f78f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:21.996477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fd64c-acf0-44b7-a41c-cd3f3d7f78f4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:22.003566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 138/279] 10.222.0.57 () {56 vars in 1308 bytes} [Tue May 10 16:31:21 2022] GET /identity/v3/role_assignments?user.id=fdea172edc2f40ff915f18d8490ad4b3&scope.system=all&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:22.170032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047cd70-22d1-4c8b-936e-61a737d267a2 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:22.170421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047cd70-22d1-4c8b-936e-61a737d267a2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:22.170604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047cd70-22d1-4c8b-936e-61a737d267a2 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:22.172330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 142/280] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:22.177701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763437-a7b8-4165-a19b-c8c93ccef784 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:22.177982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763437-a7b8-4165-a19b-c8c93ccef784 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:22.178256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763437-a7b8-4165-a19b-c8c93ccef784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:22.196514 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d5763437-a7b8-4165-a19b-c8c93ccef784 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:22.197685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d5763437-a7b8-4165-a19b-c8c93ccef784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:22.267904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 139/281] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:22.289958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047cd70-22d1-4c8b-936e-61a737d267a2 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:22.400193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047cd70-22d1-4c8b-936e-61a737d267a2 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:22.443749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6234f2-2f81-4dbf-9895-e34ec2f7fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:22.445275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6234f2-2f81-4dbf-9895-e34ec2f7fb9a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:22.445741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6234f2-2f81-4dbf-9895-e34ec2f7fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:22.446208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6234f2-2f81-4dbf-9895-e34ec2f7fb9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:22.457332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6234f2-2f81-4dbf-9895-e34ec2f7fb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1e6234f2-2f81-4dbf-9895-e34ec2f7fb9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:22.465594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:22.467086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:22.467912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:22.470014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 143/282] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:22.476022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5763437-a7b8-4165-a19b-c8c93ccef784 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:22.584220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5763437-a7b8-4165-a19b-c8c93ccef784 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:22.631564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:22.632237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:22.632523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:22.632798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:22.633557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:22.633861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:22.635272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:22.646441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 140/283] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:22.651868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6234f2-2f81-4dbf-9895-e34ec2f7fb9a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:22.791988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6234f2-2f81-4dbf-9895-e34ec2f7fb9a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:22.825123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10ba60-ddbe-4a65-9dcd-81e556bb52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:22.826529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10ba60-ddbe-4a65-9dcd-81e556bb52d2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:22.826810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10ba60-ddbe-4a65-9dcd-81e556bb52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:22.827124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10ba60-ddbe-4a65-9dcd-81e556bb52d2 None admin] PATH_INFO: `/v3/users/a6ebc30337ec4b229182ccbfaff67de7` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:22.828332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10ba60-ddbe-4a65-9dcd-81e556bb52d2 None admin] RBAC: Authorizing `identity:get_user(user_id=a6ebc30337ec4b229182ccbfaff67de7)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:22.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10ba60-ddbe-4a65-9dcd-81e556bb52d2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:22.831608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 144/284] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:22 2022] GET /identity/v3/users/a6ebc30337ec4b229182ccbfaff67de7 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:22.836971 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:22.976853 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae84a4-86a2-467d-b896-4e18c938f749 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:23.014505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710bbfe-0b71-42e2-b0d3-30a25b17ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:23.015394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710bbfe-0b71-42e2-b0d3-30a25b17ec32 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:23.015673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710bbfe-0b71-42e2-b0d3-30a25b17ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:23.015941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710bbfe-0b71-42e2-b0d3-30a25b17ec32 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:23.019675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710bbfe-0b71-42e2-b0d3-30a25b17ec32 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:23.021110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710bbfe-0b71-42e2-b0d3-30a25b17ec32 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:23.023117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 141/285] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:22 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:23.028561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10ba60-ddbe-4a65-9dcd-81e556bb52d2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:23.140266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e64ecb-5fc3-4bb9-97af-5eaab1f1575f None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:23.140573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e64ecb-5fc3-4bb9-97af-5eaab1f1575f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:23.140819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e64ecb-5fc3-4bb9-97af-5eaab1f1575f None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:23.142399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 142/286] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:23.147452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca3da9-b945-4209-bc3e-386c2d5af73f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:23.147738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca3da9-b945-4209-bc3e-386c2d5af73f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:23.148014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca3da9-b945-4209-bc3e-386c2d5af73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:23.161549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10ba60-ddbe-4a65-9dcd-81e556bb52d2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:23.187951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-0eca3da9-b945-4209-bc3e-386c2d5af73f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:23.189162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-0eca3da9-b945-4209-bc3e-386c2d5af73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:23.195428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5127c3-2bb6-4dee-a5f2-e80aa627601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:23.196364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5127c3-2bb6-4dee-a5f2-e80aa627601b None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:23.196652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5127c3-2bb6-4dee-a5f2-e80aa627601b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:23.196929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5127c3-2bb6-4dee-a5f2-e80aa627601b None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/users/a6ebc30337ec4b229182ccbfaff67de7/roles/5fef016fde6f4145b0c37046cd31dc8d` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:23.209390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5127c3-2bb6-4dee-a5f2-e80aa627601b None admin] RBAC: Authorizing `identity:create_grant(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a, user_id=a6ebc30337ec4b229182ccbfaff67de7, role_id=5fef016fde6f4145b0c37046cd31dc8d)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:23.210911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5127c3-2bb6-4dee-a5f2-e80aa627601b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:23.230820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 145/287] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:31:23 2022] PUT /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/users/a6ebc30337ec4b229182ccbfaff67de7/roles/5fef016fde6f4145b0c37046cd31dc8d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:23.280700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 143/288] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:23.312266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5127c3-2bb6-4dee-a5f2-e80aa627601b None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:23.459300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5127c3-2bb6-4dee-a5f2-e80aa627601b None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:23.506336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c2191-443d-4fc2-b093-ee7951ab9e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:23.507171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2191-443d-4fc2-b093-ee7951ab9e28 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:23.507456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2191-443d-4fc2-b093-ee7951ab9e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:23.507729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c2191-443d-4fc2-b093-ee7951ab9e28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:23.521837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c2191-443d-4fc2-b093-ee7951ab9e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1c6c2191-443d-4fc2-b093-ee7951ab9e28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:23.529801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:23.530673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:23.531514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 146/289] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:23.536875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca3da9-b945-4209-bc3e-386c2d5af73f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:23.653051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca3da9-b945-4209-bc3e-386c2d5af73f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:23.700541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:23.701614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:23.702097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:23.702587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:23.703575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:23.704105 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:23.705690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:23.714562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 144/290] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:23.720114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c2191-443d-4fc2-b093-ee7951ab9e28 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:23.882989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c2191-443d-4fc2-b093-ee7951ab9e28 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:23.911645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22a6cf-f34b-421d-999e-f7f0faea609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:23.912519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22a6cf-f34b-421d-999e-f7f0faea609c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:23.912799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22a6cf-f34b-421d-999e-f7f0faea609c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:23.913075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22a6cf-f34b-421d-999e-f7f0faea609c None admin] PATH_INFO: `/v3/users/a2b61c9e05fd4892841840ea805bbfd9` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:23.914276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22a6cf-f34b-421d-999e-f7f0faea609c None admin] RBAC: Authorizing `identity:get_user(user_id=a2b61c9e05fd4892841840ea805bbfd9)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:23.915753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22a6cf-f34b-421d-999e-f7f0faea609c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:23.917671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 147/291] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:23 2022] GET /identity/v3/users/a2b61c9e05fd4892841840ea805bbfd9 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:23.923563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:24.050591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee311e-6bdf-47ff-9995-18e3fcb73dac None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:24.084077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289dded-cde2-4b61-8e59-29c9bd801f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:24.085078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289dded-cde2-4b61-8e59-29c9bd801f53 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:24.085565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289dded-cde2-4b61-8e59-29c9bd801f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:24.086041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289dded-cde2-4b61-8e59-29c9bd801f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:24.155318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289dded-cde2-4b61-8e59-29c9bd801f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:24.157171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289dded-cde2-4b61-8e59-29c9bd801f53 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:24.258517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 145/292] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:24.267143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22a6cf-f34b-421d-999e-f7f0faea609c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:24.387029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22a6cf-f34b-421d-999e-f7f0faea609c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:24.421633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b4447-2be0-4425-acfb-5282a0cc1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:24.422500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4447-2be0-4425-acfb-5282a0cc1dfb None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:24.422777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4447-2be0-4425-acfb-5282a0cc1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:24.423083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4447-2be0-4425-acfb-5282a0cc1dfb None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:24.424287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b4447-2be0-4425-acfb-5282a0cc1dfb None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:24.425727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b4447-2be0-4425-acfb-5282a0cc1dfb None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:24.427781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 148/293] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:24 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:24.433128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289dded-cde2-4b61-8e59-29c9bd801f53 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:24.595752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289dded-cde2-4b61-8e59-29c9bd801f53 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:24.647840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081e285-6799-41fb-9212-190563ec7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:24.648436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e285-6799-41fb-9212-190563ec7e96 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:24.648719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e285-6799-41fb-9212-190563ec7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:24.648994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e285-6799-41fb-9212-190563ec7e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:24.649854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e285-6799-41fb-9212-190563ec7e96 None admin] RBAC: Adding query filter params (role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a, user.id=a2b61c9e05fd4892841840ea805bbfd9) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:24.650169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e285-6799-41fb-9212-190563ec7e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:24.651712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e285-6799-41fb-9212-190563ec7e96 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:24.664570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 146/294] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:24 2022] GET /identity/v3/role_assignments?user.id=a2b61c9e05fd4892841840ea805bbfd9&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:24.837008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ad1e8-c3b7-479b-ae73-252031703551 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:24.837536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ad1e8-c3b7-479b-ae73-252031703551 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:24.837536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ad1e8-c3b7-479b-ae73-252031703551 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:24.839396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 149/295] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:24.845197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2f211-040f-4948-a6ee-de26a3019201 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:24.845504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2f211-040f-4948-a6ee-de26a3019201 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:24.845756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2f211-040f-4948-a6ee-de26a3019201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:24.855700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebc5a9-5892-4e4b-a236-0448db924725 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:24.856021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebc5a9-5892-4e4b-a236-0448db924725 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:24.856257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebc5a9-5892-4e4b-a236-0448db924725 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:24.857763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 150/296] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:24.863508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1dcda-1995-4546-8e06-150e71696a54 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:24.863802 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1dcda-1995-4546-8e06-150e71696a54 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:24.864074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1dcda-1995-4546-8e06-150e71696a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:24.877233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-39f2f211-040f-4948-a6ee-de26a3019201 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:24.878464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-39f2f211-040f-4948-a6ee-de26a3019201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:24.882871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-65d1dcda-1995-4546-8e06-150e71696a54 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:24.884142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-65d1dcda-1995-4546-8e06-150e71696a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:24.957931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 151/297] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:24.987590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1dcda-1995-4546-8e06-150e71696a54 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.006377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 147/298] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:25.034863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2f211-040f-4948-a6ee-de26a3019201 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.111198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1dcda-1995-4546-8e06-150e71696a54 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.148078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d769a84-e535-43e0-af78-a6cea7ac43e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.148871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769a84-e535-43e0-af78-a6cea7ac43e1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.149164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769a84-e535-43e0-af78-a6cea7ac43e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.149428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769a84-e535-43e0-af78-a6cea7ac43e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.152089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2f211-040f-4948-a6ee-de26a3019201 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.159430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d769a84-e535-43e0-af78-a6cea7ac43e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-4d769a84-e535-43e0-af78-a6cea7ac43e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:25.167242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:25.168142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:25.168946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 152/299] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:25.172379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b39dd-c794-4703-975e-3a503c44a04a None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.172741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b39dd-c794-4703-975e-3a503c44a04a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.173085 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b39dd-c794-4703-975e-3a503c44a04a None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.174578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 153/300] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:25.178645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b39dd-c794-4703-975e-3a503c44a04a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.195267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07f80-36cf-424d-9ab1-431cbef87a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.196106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f80-36cf-424d-9ab1-431cbef87a98 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.196382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f80-36cf-424d-9ab1-431cbef87a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.196652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f80-36cf-424d-9ab1-431cbef87a98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.206205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07f80-36cf-424d-9ab1-431cbef87a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-a4c07f80-36cf-424d-9ab1-431cbef87a98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:25.213957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:25.215097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:25.215917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 148/301] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:25.216967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacca58-7b4f-4243-a767-867d823d2721 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.216967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacca58-7b4f-4243-a767-867d823d2721 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.217217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacca58-7b4f-4243-a767-867d823d2721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.233170 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1cacca58-7b4f-4243-a767-867d823d2721 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:25.234321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1cacca58-7b4f-4243-a767-867d823d2721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:25.284885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b39dd-c794-4703-975e-3a503c44a04a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.298118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 149/302] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:25.299302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacca58-7b4f-4243-a767-867d823d2721 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.330895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.331599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.331888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.332167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.332922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:25.333233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:25.334619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:25.343355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 154/303] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:25.343963 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.407207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacca58-7b4f-4243-a767-867d823d2721 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.439644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ca77b-3c83-4b21-83de-3765232e432c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.440650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.441354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.441639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.441918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.442673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:25.443152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:25.444410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:25.452817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 150/304] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:25.453625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.478745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e21333-1c8b-43d5-9f0b-2af148a4d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.479576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21333-1c8b-43d5-9f0b-2af148a4d14a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.479866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21333-1c8b-43d5-9f0b-2af148a4d14a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.480142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21333-1c8b-43d5-9f0b-2af148a4d14a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.481292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e21333-1c8b-43d5-9f0b-2af148a4d14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:25.483306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e21333-1c8b-43d5-9f0b-2af148a4d14a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:25.485087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 155/305] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:25.485654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e21333-1c8b-43d5-9f0b-2af148a4d14a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.558078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9419368-e825-4105-83b3-0b8e94c4e8b6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.583568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e21333-1c8b-43d5-9f0b-2af148a4d14a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.590234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00b6fb-a9a3-41cb-87ac-b1dce4437814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.591136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00b6fb-a9a3-41cb-87ac-b1dce4437814 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.591947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00b6fb-a9a3-41cb-87ac-b1dce4437814 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.592219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00b6fb-a9a3-41cb-87ac-b1dce4437814 None admin] PATH_INFO: `/v3/users/2d0e850b876643a48ac7aa31bd90db4f` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.604963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00b6fb-a9a3-41cb-87ac-b1dce4437814 None admin] RBAC: Authorizing `identity:get_user(user_id=2d0e850b876643a48ac7aa31bd90db4f)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:25.606424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00b6fb-a9a3-41cb-87ac-b1dce4437814 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:25.608935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 151/306] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:25 2022] GET /identity/v3/users/2d0e850b876643a48ac7aa31bd90db4f => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:25.614043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00b6fb-a9a3-41cb-87ac-b1dce4437814 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.617386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751e46f-32f3-49fa-adbf-0f223691f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.618264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751e46f-32f3-49fa-adbf-0f223691f0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.618550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751e46f-32f3-49fa-adbf-0f223691f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.618827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751e46f-32f3-49fa-adbf-0f223691f0e8 None admin] PATH_INFO: `/v3/users/fdea172edc2f40ff915f18d8490ad4b3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.620062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751e46f-32f3-49fa-adbf-0f223691f0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=fdea172edc2f40ff915f18d8490ad4b3)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:25.621510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751e46f-32f3-49fa-adbf-0f223691f0e8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:25.627833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 156/307] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:25 2022] GET /identity/v3/users/fdea172edc2f40ff915f18d8490ad4b3 => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:25.627833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751e46f-32f3-49fa-adbf-0f223691f0e8 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.708095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00b6fb-a9a3-41cb-87ac-b1dce4437814 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.724226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751e46f-32f3-49fa-adbf-0f223691f0e8 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.741456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b13b6a-3d35-4bf5-89de-60a72ae36ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.742061 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b13b6a-3d35-4bf5-89de-60a72ae36ddc None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.742341 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b13b6a-3d35-4bf5-89de-60a72ae36ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.742618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b13b6a-3d35-4bf5-89de-60a72ae36ddc None admin] PATH_INFO: `/v3/groups` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.743330 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b13b6a-3d35-4bf5-89de-60a72ae36ddc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:25.744766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b13b6a-3d35-4bf5-89de-60a72ae36ddc None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:25.756758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1a162-3fc6-4edf-8fd3-e3bfd818bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.757402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1a162-3fc6-4edf-8fd3-e3bfd818bc44 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.757682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1a162-3fc6-4edf-8fd3-e3bfd818bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.757954 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1a162-3fc6-4edf-8fd3-e3bfd818bc44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.758770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1a162-3fc6-4edf-8fd3-e3bfd818bc44 None admin] RBAC: Adding query filter params (role.id=5fef016fde6f4145b0c37046cd31dc8d, user.id=2d0e850b876643a48ac7aa31bd90db4f, scope.system=all) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:25.759212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 152/308] 10.222.0.57 () {60 vars in 1134 bytes} [Tue May 10 16:31:25 2022] POST /identity/v3/groups => generated 229 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:25.759314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1a162-3fc6-4edf-8fd3-e3bfd818bc44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:25.760648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1a162-3fc6-4edf-8fd3-e3bfd818bc44 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:25.766621 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 157/309] 10.222.0.57 () {56 vars in 1308 bytes} [Tue May 10 16:31:25 2022] GET /identity/v3/role_assignments?user.id=2d0e850b876643a48ac7aa31bd90db4f&scope.system=all&role.id=5fef016fde6f4145b0c37046cd31dc8d => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:25.767970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b13b6a-3d35-4bf5-89de-60a72ae36ddc None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:25.906950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b13b6a-3d35-4bf5-89de-60a72ae36ddc None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:25.945914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fd832-ecec-46b6-b7b0-bf57d052f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:25.946814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd832-ecec-46b6-b7b0-bf57d052f771 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:25.947137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd832-ecec-46b6-b7b0-bf57d052f771 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:25.947414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fd832-ecec-46b6-b7b0-bf57d052f771 None admin] PATH_INFO: `/v3/system/users/fdea172edc2f40ff915f18d8490ad4b3/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:25.949098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fd832-ecec-46b6-b7b0-bf57d052f771 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fdea172edc2f40ff915f18d8490ad4b3, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:25.950537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fd832-ecec-46b6-b7b0-bf57d052f771 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:25.961932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 153/310] 10.222.0.57 () {58 vars in 1334 bytes} [Tue May 10 16:31:25 2022] PUT /identity/v3/system/users/fdea172edc2f40ff915f18d8490ad4b3/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:26.020006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1827-aef6-42f0-892a-e0c86b25b43a None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:26.020530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1827-aef6-42f0-892a-e0c86b25b43a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:26.020530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1827-aef6-42f0-892a-e0c86b25b43a None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:26.021967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 158/311] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:26.028060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aef1d-20a5-44c8-8b3a-d5224d094b00 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:26.028583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aef1d-20a5-44c8-8b3a-d5224d094b00 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:26.028583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aef1d-20a5-44c8-8b3a-d5224d094b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:26.048564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-782aef1d-20a5-44c8-8b3a-d5224d094b00 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:26.049736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-782aef1d-20a5-44c8-8b3a-d5224d094b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:26.125199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 154/312] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:26.148240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a1827-aef6-42f0-892a-e0c86b25b43a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:26.259483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a1827-aef6-42f0-892a-e0c86b25b43a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:26.292624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de779c70-951b-4704-8fcf-4248ec757bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:26.293739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779c70-951b-4704-8fcf-4248ec757bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:26.294517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779c70-951b-4704-8fcf-4248ec757bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:26.295027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779c70-951b-4704-8fcf-4248ec757bb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:26.306172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de779c70-951b-4704-8fcf-4248ec757bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-de779c70-951b-4704-8fcf-4248ec757bb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:26.314880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:26.315771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:26.316572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:26.319274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 159/313] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:26.328053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782aef1d-20a5-44c8-8b3a-d5224d094b00 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:26.424570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782aef1d-20a5-44c8-8b3a-d5224d094b00 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:26.460417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:26.461089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:26.461368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:26.461639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:26.462390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:26.462696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:26.464120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:26.472311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 155/314] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:26.480200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de779c70-951b-4704-8fcf-4248ec757bb8 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:26.581379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de779c70-951b-4704-8fcf-4248ec757bb8 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:26.614996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3410ec-6efe-4daf-87d4-03f55a0ee7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:26.615880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3410ec-6efe-4daf-87d4-03f55a0ee7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:26.616157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3410ec-6efe-4daf-87d4-03f55a0ee7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:26.616430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3410ec-6efe-4daf-87d4-03f55a0ee7e2 None admin] PATH_INFO: `/v3/users/a6ebc30337ec4b229182ccbfaff67de7` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:26.617627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3410ec-6efe-4daf-87d4-03f55a0ee7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=a6ebc30337ec4b229182ccbfaff67de7)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:26.619133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3410ec-6efe-4daf-87d4-03f55a0ee7e2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:26.621086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 160/315] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:26 2022] GET /identity/v3/users/a6ebc30337ec4b229182ccbfaff67de7 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:26.626506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:26.727334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7c159-bb2d-4884-a162-16c132520aed None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:26.760161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34924033-05e4-4b1c-9559-309efddebdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:26.760806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924033-05e4-4b1c-9559-309efddebdbc None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:26.761083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924033-05e4-4b1c-9559-309efddebdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:26.761354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924033-05e4-4b1c-9559-309efddebdbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:26.827491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34924033-05e4-4b1c-9559-309efddebdbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:26.828956 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34924033-05e4-4b1c-9559-309efddebdbc None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:26.924681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 156/316] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:26.930176 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3410ec-6efe-4daf-87d4-03f55a0ee7e2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:27.036269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3410ec-6efe-4daf-87d4-03f55a0ee7e2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:27.069999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f19b7-c19d-455e-892e-7e2829195194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:27.070905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f19b7-c19d-455e-892e-7e2829195194 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:27.071252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f19b7-c19d-455e-892e-7e2829195194 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:27.071519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f19b7-c19d-455e-892e-7e2829195194 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:27.072701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f19b7-c19d-455e-892e-7e2829195194 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:27.074177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f19b7-c19d-455e-892e-7e2829195194 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:27.076732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 161/317] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:26 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:27.082414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34924033-05e4-4b1c-9559-309efddebdbc None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:27.183696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34924033-05e4-4b1c-9559-309efddebdbc None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:27.217750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97587fa-6123-4281-befb-27e3ab624a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:27.218447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97587fa-6123-4281-befb-27e3ab624a71 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:27.218732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97587fa-6123-4281-befb-27e3ab624a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:27.219027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97587fa-6123-4281-befb-27e3ab624a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:27.219897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97587fa-6123-4281-befb-27e3ab624a71 None admin] RBAC: Adding query filter params (role.id=5fef016fde6f4145b0c37046cd31dc8d, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a, user.id=a6ebc30337ec4b229182ccbfaff67de7) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:27.220206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97587fa-6123-4281-befb-27e3ab624a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:27.221635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97587fa-6123-4281-befb-27e3ab624a71 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:27.227848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 157/318] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:27 2022] GET /identity/v3/role_assignments?user.id=a6ebc30337ec4b229182ccbfaff67de7&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=5fef016fde6f4145b0c37046cd31dc8d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:28.107835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904f0e-0c66-4828-aac7-9f18707cd84e None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.108361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904f0e-0c66-4828-aac7-9f18707cd84e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.108464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904f0e-0c66-4828-aac7-9f18707cd84e None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.109892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 162/319] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:28.114890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779e2ef-2187-40a4-83c4-d209c4d8575b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.115331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779e2ef-2187-40a4-83c4-d209c4d8575b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.115535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779e2ef-2187-40a4-83c4-d209c4d8575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.130097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250076b-9108-4a45-b326-ca23f7cab74c None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.130388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250076b-9108-4a45-b326-ca23f7cab74c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.130654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250076b-9108-4a45-b326-ca23f7cab74c None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.131903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-4779e2ef-2187-40a4-83c4-d209c4d8575b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:28.132287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 163/320] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:28.133075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4779e2ef-2187-40a4-83c4-d209c4d8575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:28.137638 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347deda-9ce4-4360-91bc-e9fe59897dd7 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.137926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347deda-9ce4-4360-91bc-e9fe59897dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.138736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347deda-9ce4-4360-91bc-e9fe59897dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.156116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b347deda-9ce4-4360-91bc-e9fe59897dd7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:28.157384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b347deda-9ce4-4360-91bc-e9fe59897dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:28.198851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 158/321] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:28.222097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779e2ef-2187-40a4-83c4-d209c4d8575b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.224826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 164/322] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:28.247171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347deda-9ce4-4360-91bc-e9fe59897dd7 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.315304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779e2ef-2187-40a4-83c4-d209c4d8575b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.339214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347deda-9ce4-4360-91bc-e9fe59897dd7 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.347781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48069a1f-ce82-4bdf-bbc8-f8e8fb4ceebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.348577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069a1f-ce82-4bdf-bbc8-f8e8fb4ceebc None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.348860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069a1f-ce82-4bdf-bbc8-f8e8fb4ceebc None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.349135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069a1f-ce82-4bdf-bbc8-f8e8fb4ceebc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.358726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48069a1f-ce82-4bdf-bbc8-f8e8fb4ceebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-48069a1f-ce82-4bdf-bbc8-f8e8fb4ceebc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:28.366540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:28.367481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:28.368255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 159/323] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:28.369410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542952d-e204-46e9-9e23-11725ecbb569 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.369701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542952d-e204-46e9-9e23-11725ecbb569 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.369977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542952d-e204-46e9-9e23-11725ecbb569 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.371270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 160/324] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:28.373693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5196-6a9b-4afd-85fe-ddd2c35aade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.373924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542952d-e204-46e9-9e23-11725ecbb569 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.374484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5196-6a9b-4afd-85fe-ddd2c35aade8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.374764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5196-6a9b-4afd-85fe-ddd2c35aade8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.375059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5196-6a9b-4afd-85fe-ddd2c35aade8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.376438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb5196-6a9b-4afd-85fe-ddd2c35aade8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:28.377883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb5196-6a9b-4afd-85fe-ddd2c35aade8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:28.379668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 165/325] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:28.384172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729fddd-39c7-4be0-990d-27a29bdd10ce None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.384465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729fddd-39c7-4be0-990d-27a29bdd10ce None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.384746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729fddd-39c7-4be0-990d-27a29bdd10ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.401021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c729fddd-39c7-4be0-990d-27a29bdd10ce None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:28.402131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c729fddd-39c7-4be0-990d-27a29bdd10ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:28.464874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 166/326] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:28.465707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729fddd-39c7-4be0-990d-27a29bdd10ce None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.470642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542952d-e204-46e9-9e23-11725ecbb569 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.504080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.504733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.505010 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.505282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.506017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:28.506323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:28.507723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:28.516890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 161/327] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:28.517654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.558133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729fddd-39c7-4be0-990d-27a29bdd10ce None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.590237 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083fe5-b829-4f58-a00a-38db889d8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.591042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083fe5-b829-4f58-a00a-38db889d8c2d None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.591331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083fe5-b829-4f58-a00a-38db889d8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.591611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083fe5-b829-4f58-a00a-38db889d8c2d None admin] PATH_INFO: `/v3/groups` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.592341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083fe5-b829-4f58-a00a-38db889d8c2d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:28.593809 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083fe5-b829-4f58-a00a-38db889d8c2d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:28.608177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 167/328] 10.222.0.57 () {60 vars in 1134 bytes} [Tue May 10 16:31:28 2022] POST /identity/v3/groups => generated 226 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:28.608957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083fe5-b829-4f58-a00a-38db889d8c2d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.612638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523e9f5-c12f-42c4-a0c2-b32e88d8c241 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.649113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd73985-25b6-4fe2-8527-2c1b0b2ca880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.650061 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73985-25b6-4fe2-8527-2c1b0b2ca880 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.650419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73985-25b6-4fe2-8527-2c1b0b2ca880 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.650773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73985-25b6-4fe2-8527-2c1b0b2ca880 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.661756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd73985-25b6-4fe2-8527-2c1b0b2ca880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-fdd73985-25b6-4fe2-8527-2c1b0b2ca880 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:28.670147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:28.671176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:28.672363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 162/329] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:28.677813 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd73985-25b6-4fe2-8527-2c1b0b2ca880 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.722432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083fe5-b829-4f58-a00a-38db889d8c2d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.760101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e407d-50ef-4d5a-9c2e-a8a6f6487c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.760997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e407d-50ef-4d5a-9c2e-a8a6f6487c8b None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.761278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e407d-50ef-4d5a-9c2e-a8a6f6487c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.761551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e407d-50ef-4d5a-9c2e-a8a6f6487c8b None admin] PATH_INFO: `/v3/users/2d0e850b876643a48ac7aa31bd90db4f` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.762841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e407d-50ef-4d5a-9c2e-a8a6f6487c8b None admin] RBAC: Authorizing `identity:get_user(user_id=2d0e850b876643a48ac7aa31bd90db4f)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:28.764403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e407d-50ef-4d5a-9c2e-a8a6f6487c8b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:28.766262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 168/330] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:28 2022] GET /identity/v3/users/2d0e850b876643a48ac7aa31bd90db4f => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:28.771946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e407d-50ef-4d5a-9c2e-a8a6f6487c8b None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.784567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd73985-25b6-4fe2-8527-2c1b0b2ca880 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.824322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.825001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.825280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.825552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.826343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:28.826653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:28.828077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:28.837245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 163/331] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:28.842576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:28.883342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e407d-50ef-4d5a-9c2e-a8a6f6487c8b None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.917837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aa334-26e2-433e-b1a7-cf5e122686c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.918759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aa334-26e2-433e-b1a7-cf5e122686c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.919088 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aa334-26e2-433e-b1a7-cf5e122686c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.920193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aa334-26e2-433e-b1a7-cf5e122686c7 None admin] PATH_INFO: `/v3/system/users/2d0e850b876643a48ac7aa31bd90db4f/roles/5fef016fde6f4145b0c37046cd31dc8d` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:28.922174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47aa334-26e2-433e-b1a7-cf5e122686c7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2d0e850b876643a48ac7aa31bd90db4f, role_id=5fef016fde6f4145b0c37046cd31dc8d)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:28.923897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47aa334-26e2-433e-b1a7-cf5e122686c7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:28.937889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 169/332] 10.222.0.57 () {58 vars in 1334 bytes} [Tue May 10 16:31:28 2022] PUT /identity/v3/system/users/2d0e850b876643a48ac7aa31bd90db4f/roles/5fef016fde6f4145b0c37046cd31dc8d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:31:28.957647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9015e8-d964-423c-bcf7-c3153ffdac6d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:28.997168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc5699-7737-49f7-b85a-3423be96dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:28.998653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5699-7737-49f7-b85a-3423be96dcbb None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:28.998929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5699-7737-49f7-b85a-3423be96dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:28.999299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5699-7737-49f7-b85a-3423be96dcbb None admin] PATH_INFO: `/v3/users/fdea172edc2f40ff915f18d8490ad4b3` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:29.000615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5699-7737-49f7-b85a-3423be96dcbb None admin] RBAC: Authorizing `identity:get_user(user_id=fdea172edc2f40ff915f18d8490ad4b3)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:29.002106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5699-7737-49f7-b85a-3423be96dcbb None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:29.003842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 164/333] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:28 2022] GET /identity/v3/users/fdea172edc2f40ff915f18d8490ad4b3 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:29.009805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aa334-26e2-433e-b1a7-cf5e122686c7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:29.126613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aa334-26e2-433e-b1a7-cf5e122686c7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:29.163241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc3c42-91e6-49d0-9906-bbb2d92ba955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:29.164259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3c42-91e6-49d0-9906-bbb2d92ba955 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:29.164748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3c42-91e6-49d0-9906-bbb2d92ba955 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:29.165229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3c42-91e6-49d0-9906-bbb2d92ba955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:29.166295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc3c42-91e6-49d0-9906-bbb2d92ba955 None admin] RBAC: Adding query filter params (role.id=6ec804c74dad4bf8847c06a34d95505a, user.id=fdea172edc2f40ff915f18d8490ad4b3, scope.system=all) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:29.166810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc3c42-91e6-49d0-9906-bbb2d92ba955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:29.168547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc3c42-91e6-49d0-9906-bbb2d92ba955 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:29.182480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 170/334] 10.222.0.57 () {56 vars in 1308 bytes} [Tue May 10 16:31:29 2022] GET /identity/v3/role_assignments?user.id=fdea172edc2f40ff915f18d8490ad4b3&scope.system=all&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:31.334058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3a052-7346-4cac-8213-5f361cbb7d37 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:31.334595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3a052-7346-4cac-8213-5f361cbb7d37 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:31.334595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3a052-7346-4cac-8213-5f361cbb7d37 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:31.336354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 165/335] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:31.352933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d179c-dde1-4fef-81da-587b589b569a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:31.353909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d179c-dde1-4fef-81da-587b589b569a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:31.354391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d179c-dde1-4fef-81da-587b589b569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:31.375901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-2f3d179c-dde1-4fef-81da-587b589b569a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:31.377458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2f3d179c-dde1-4fef-81da-587b589b569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:31.469676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 171/336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:31.510882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3a052-7346-4cac-8213-5f361cbb7d37 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:31.608105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df6ce-14b9-414b-bd67-d902a2a4e247 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:31.608712 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df6ce-14b9-414b-bd67-d902a2a4e247 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:31.609190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df6ce-14b9-414b-bd67-d902a2a4e247 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:31.615121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 172/337] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:31.620385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78376c-84a0-42c1-a594-f7e40582da82 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:31.620901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78376c-84a0-42c1-a594-f7e40582da82 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:31.621374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78376c-84a0-42c1-a594-f7e40582da82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:31.640607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3a052-7346-4cac-8213-5f361cbb7d37 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:31.654933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ae78376c-84a0-42c1-a594-f7e40582da82 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:31.656580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ae78376c-84a0-42c1-a594-f7e40582da82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:31.682406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447de7-1a43-4801-927e-1c48421e93c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:31.686306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447de7-1a43-4801-927e-1c48421e93c4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:31.686306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447de7-1a43-4801-927e-1c48421e93c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:31.686306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447de7-1a43-4801-927e-1c48421e93c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:31.700265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25447de7-1a43-4801-927e-1c48421e93c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-25447de7-1a43-4801-927e-1c48421e93c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:31.708534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:31.709430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:31.710869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 166/338] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:31.715594 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447de7-1a43-4801-927e-1c48421e93c4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:31.758685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 173/339] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:31.807938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78376c-84a0-42c1-a594-f7e40582da82 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:31.837041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447de7-1a43-4801-927e-1c48421e93c4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:31.884405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:31.890983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:31.890983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:31.890983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:31.890983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:31.890983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:31.890983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:31.903027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 167/340] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:31.909257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:31.953032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78376c-84a0-42c1-a594-f7e40582da82 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:32.000523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39444917-d95f-4830-b9f6-d2bb24dc3d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:32.001402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444917-d95f-4830-b9f6-d2bb24dc3d47 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.001690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444917-d95f-4830-b9f6-d2bb24dc3d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.001970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39444917-d95f-4830-b9f6-d2bb24dc3d47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.015896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39444917-d95f-4830-b9f6-d2bb24dc3d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:32.020961 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc3756-969e-42ee-9836-32e72dea5b07 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-39444917-d95f-4830-b9f6-d2bb24dc3d47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:32.027789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:32.028647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:32.029495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:32.031550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 174/341] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:32.036269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39444917-d95f-4830-b9f6-d2bb24dc3d47 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:32.056551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0e32-21f8-4326-90af-482891cfc566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:32.057213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e32-21f8-4326-90af-482891cfc566 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.057496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e32-21f8-4326-90af-482891cfc566 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.058030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e32-21f8-4326-90af-482891cfc566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.176783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39444917-d95f-4830-b9f6-d2bb24dc3d47 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:32.188115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e0e32-21f8-4326-90af-482891cfc566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:32.190100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e0e32-21f8-4326-90af-482891cfc566 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:32.223118 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281ba56-d0bc-4f8c-8883-89c00f9b9825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:32.226635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281ba56-d0bc-4f8c-8883-89c00f9b9825 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.227146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281ba56-d0bc-4f8c-8883-89c00f9b9825 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.227617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281ba56-d0bc-4f8c-8883-89c00f9b9825 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.228587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281ba56-d0bc-4f8c-8883-89c00f9b9825 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:32.229086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281ba56-d0bc-4f8c-8883-89c00f9b9825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:32.230648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281ba56-d0bc-4f8c-8883-89c00f9b9825 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:32.250403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 175/342] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:32.252067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52f82-41a4-49a6-a938-bfb098d455d7 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.252568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52f82-41a4-49a6-a938-bfb098d455d7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.253035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52f82-41a4-49a6-a938-bfb098d455d7 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.254446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 176/343] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:32.259827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549e6e-b69e-4fe9-89d7-45ccb93c1473 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.260344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549e6e-b69e-4fe9-89d7-45ccb93c1473 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.260832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549e6e-b69e-4fe9-89d7-45ccb93c1473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.295218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-db549e6e-b69e-4fe9-89d7-45ccb93c1473 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:32.296759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-db549e6e-b69e-4fe9-89d7-45ccb93c1473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:32.315634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 168/344] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:31:32.316492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0e32-21f8-4326-90af-482891cfc566 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:32.409439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 177/345] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:32.410302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549e6e-b69e-4fe9-89d7-45ccb93c1473 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:32.420400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0e32-21f8-4326-90af-482891cfc566 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:32.459326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01185-849e-443f-a12d-8bde6c75741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:32.459913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01185-849e-443f-a12d-8bde6c75741c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.460196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01185-849e-443f-a12d-8bde6c75741c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.460471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01185-849e-443f-a12d-8bde6c75741c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.532423 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb01185-849e-443f-a12d-8bde6c75741c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:32.533888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb01185-849e-443f-a12d-8bde6c75741c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:32.545491 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549e6e-b69e-4fe9-89d7-45ccb93c1473 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:32.588728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe8777-7d96-4fd2-a8ac-8a8c242e69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:32.589596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe8777-7d96-4fd2-a8ac-8a8c242e69b5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.589928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe8777-7d96-4fd2-a8ac-8a8c242e69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.590207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe8777-7d96-4fd2-a8ac-8a8c242e69b5 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.591971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe8777-7d96-4fd2-a8ac-8a8c242e69b5 None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:32.593461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe8777-7d96-4fd2-a8ac-8a8c242e69b5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:32.595473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 178/346] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:32 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:32.596665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e578-c268-4eec-8922-ddfa6436ff2f None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.596948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e578-c268-4eec-8922-ddfa6436ff2f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.597222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e578-c268-4eec-8922-ddfa6436ff2f None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.598441 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 179/347] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:32.599205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e578-c268-4eec-8922-ddfa6436ff2f None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:32.636897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 169/348] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:32.637751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01185-849e-443f-a12d-8bde6c75741c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:32.710949 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e578-c268-4eec-8922-ddfa6436ff2f None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:32.736608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01185-849e-443f-a12d-8bde6c75741c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:32.747037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73eb132-fbd9-4aba-bf83-f6c4da691ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:32.748116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eb132-fbd9-4aba-bf83-f6c4da691ada None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.748540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eb132-fbd9-4aba-bf83-f6c4da691ada None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.748953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eb132-fbd9-4aba-bf83-f6c4da691ada None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.761602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73eb132-fbd9-4aba-bf83-f6c4da691ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:32.770529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e177a-938c-4817-8ba0-4a9e3f430227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-d73eb132-fbd9-4aba-bf83-f6c4da691ada None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:32.771162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:32.772256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:31:32.773239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:32.773990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e177a-938c-4817-8ba0-4a9e3f430227 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.773990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e177a-938c-4817-8ba0-4a9e3f430227 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.773990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e177a-938c-4817-8ba0-4a9e3f430227 None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.775523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 180/349] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:32.779671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923e92b-af88-4782-a9bf-c98252a195dc None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:32.780249 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923e92b-af88-4782-a9bf-c98252a195dc None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:32.780674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923e92b-af88-4782-a9bf-c98252a195dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:32.783764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e177a-938c-4817-8ba0-4a9e3f430227 None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:32.785407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e177a-938c-4817-8ba0-4a9e3f430227 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:32.787557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 170/350] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:32 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:32.788393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e177a-938c-4817-8ba0-4a9e3f430227 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:32.809435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5923e92b-af88-4782-a9bf-c98252a195dc None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:32.810752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5923e92b-af88-4782-a9bf-c98252a195dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:32.897988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 181/351] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:32.898848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923e92b-af88-4782-a9bf-c98252a195dc None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:32.961513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e177a-938c-4817-8ba0-4a9e3f430227 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.011436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664e2f-b7ab-4c6d-8daf-a23475d53a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.012373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664e2f-b7ab-4c6d-8daf-a23475d53a6f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.012657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664e2f-b7ab-4c6d-8daf-a23475d53a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.015714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664e2f-b7ab-4c6d-8daf-a23475d53a6f None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.017645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a664e2f-b7ab-4c6d-8daf-a23475d53a6f None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:33.019911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a664e2f-b7ab-4c6d-8daf-a23475d53a6f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:33.024163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 171/352] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:32 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:33.024360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664e2f-b7ab-4c6d-8daf-a23475d53a6f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.049834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923e92b-af88-4782-a9bf-c98252a195dc None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.101681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.102357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.102645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.102917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.104083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] RBAC: Adding query filter params (group.id=8c0a397a89c744a4b01f9e2e6ea60766, role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:33.104396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:33.106625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:33.114193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 182/353] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:32 2022] GET /identity/v3/role_assignments?group.id=8c0a397a89c744a4b01f9e2e6ea60766&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:33.115297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.158320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664e2f-b7ab-4c6d-8daf-a23475d53a6f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.196923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.197975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.198478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.198992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.200034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:33.201106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:33.202702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:33.212649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 172/354] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:33.213836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.242042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9af1-0f53-4be7-96a2-b4a49b045a1e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.298878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e206b6-d3ba-4db9-b7ea-92661c8816bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.300102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e206b6-d3ba-4db9-b7ea-92661c8816bd None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.300602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e206b6-d3ba-4db9-b7ea-92661c8816bd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.301083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e206b6-d3ba-4db9-b7ea-92661c8816bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.316765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e206b6-d3ba-4db9-b7ea-92661c8816bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-38e206b6-d3ba-4db9-b7ea-92661c8816bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:33.325318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:33.326893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:33.327791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:33.330374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 183/355] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:33.335847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e206b6-d3ba-4db9-b7ea-92661c8816bd None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.336476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f4c4-9476-4311-b91b-58ca4a024ce3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.379390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725c5d6-669c-4ae6-94fb-0377fae56a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.379390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c5d6-669c-4ae6-94fb-0377fae56a05 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.379704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c5d6-669c-4ae6-94fb-0377fae56a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.379948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c5d6-669c-4ae6-94fb-0377fae56a05 None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.383134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c5d6-669c-4ae6-94fb-0377fae56a05 None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:33.384592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c5d6-669c-4ae6-94fb-0377fae56a05 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:33.386443 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 173/356] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:33.387599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdbd8e-a81f-461c-a1e1-4fe255811b00 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.387808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdbd8e-a81f-461c-a1e1-4fe255811b00 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.389137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdbd8e-a81f-461c-a1e1-4fe255811b00 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.392039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 174/357] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:33.392877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdbd8e-a81f-461c-a1e1-4fe255811b00 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.451722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e206b6-d3ba-4db9-b7ea-92661c8816bd None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.493000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d94ff-dfe3-41c5-957c-681a0a501cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.493575 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d94ff-dfe3-41c5-957c-681a0a501cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.493852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d94ff-dfe3-41c5-957c-681a0a501cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.494123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d94ff-dfe3-41c5-957c-681a0a501cd6 None admin] PATH_INFO: `/v3/users/2d0e850b876643a48ac7aa31bd90db4f` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.495407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d94ff-dfe3-41c5-957c-681a0a501cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=2d0e850b876643a48ac7aa31bd90db4f)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:33.496920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d94ff-dfe3-41c5-957c-681a0a501cd6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:33.498580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 184/358] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/users/2d0e850b876643a48ac7aa31bd90db4f => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:33.499900 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54760-48a2-4b56-b73a-1efb265dab3d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.500127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54760-48a2-4b56-b73a-1efb265dab3d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.500406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54760-48a2-4b56-b73a-1efb265dab3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.520248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdbd8e-a81f-461c-a1e1-4fe255811b00 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.521388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-9dd54760-48a2-4b56-b73a-1efb265dab3d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:33.522835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9dd54760-48a2-4b56-b73a-1efb265dab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:33.566664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.567642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.568082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.568507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.569400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:33.569858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:33.571437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:33.581047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 175/359] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:33.582041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.603052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 185/360] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:33.603316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54760-48a2-4b56-b73a-1efb265dab3d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.714949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57717cac-cf1e-4b28-be4d-305fc9bdbd82 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.733621 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54760-48a2-4b56-b73a-1efb265dab3d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.760259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.761267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.761554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.761847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.762673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] RBAC: Adding query filter params (group.id=8c0a397a89c744a4b01f9e2e6ea60766, role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:33.764561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:33.764998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:33.770917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 176/361] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/role_assignments?group.id=8c0a397a89c744a4b01f9e2e6ea60766&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=a3a8307844964e028f49d8bcff278ded => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:33.772623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.781782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.782455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.782742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.783046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.783915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] RBAC: Adding query filter params (role.id=5fef016fde6f4145b0c37046cd31dc8d, user.id=2d0e850b876643a48ac7aa31bd90db4f, scope.system=all) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:33.784226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:33.785893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:33.799827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 186/362] 10.222.0.57 () {56 vars in 1308 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/role_assignments?user.id=2d0e850b876643a48ac7aa31bd90db4f&scope.system=all&role.id=5fef016fde6f4145b0c37046cd31dc8d => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:33.800744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:33.893082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a53ff-639b-4c55-945a-79ab13466ace None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.915326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfbee9-d2fb-4369-bb4c-e88a97f375a3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:33.930046 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7c29b-7f46-47b4-a80e-5fc734fc6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.931052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7c29b-7f46-47b4-a80e-5fc734fc6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.931476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7c29b-7f46-47b4-a80e-5fc734fc6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.931906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7c29b-7f46-47b4-a80e-5fc734fc6ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.953716 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a0803-39ea-446f-823d-538307f18522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:33.954547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a0803-39ea-446f-823d-538307f18522 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.954824 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a0803-39ea-446f-823d-538307f18522 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.955127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a0803-39ea-446f-823d-538307f18522 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.970641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a0803-39ea-446f-823d-538307f18522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-5b9a0803-39ea-446f-823d-538307f18522 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:33.979120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:33.980097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:33.980891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 187/363] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:33.982812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdf125-22c5-4937-a23b-9cd302972558 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.982812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdf125-22c5-4937-a23b-9cd302972558 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.987298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdf125-22c5-4937-a23b-9cd302972558 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:33.989291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 188/364] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:33.995040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d6f0-26af-48d4-b7ea-325590f08ff8 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:33.995257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d6f0-26af-48d4-b7ea-325590f08ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:33.995460 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d6f0-26af-48d4-b7ea-325590f08ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.014073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-bdf9d6f0-26af-48d4-b7ea-325590f08ff8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:34.015898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bdf9d6f0-26af-48d4-b7ea-325590f08ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:34.030562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7c29b-7f46-47b4-a80e-5fc734fc6ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:34.032107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7c29b-7f46-47b4-a80e-5fc734fc6ae1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:34.147241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 189/365] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:34.148112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d6f0-26af-48d4-b7ea-325590f08ff8 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:34.186917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 177/366] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:34.191412 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7c29b-7f46-47b4-a80e-5fc734fc6ae1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:34.307561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d6f0-26af-48d4-b7ea-325590f08ff8 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:34.308553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7c29b-7f46-47b4-a80e-5fc734fc6ae1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:34.355414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:34.356346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:34.356628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:34.357467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.358432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:34.358737 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:34.360497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:34.362702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68431a6-1c38-4851-af54-146b22ce696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:34.363860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68431a6-1c38-4851-af54-146b22ce696c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:34.364354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68431a6-1c38-4851-af54-146b22ce696c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:34.364834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68431a6-1c38-4851-af54-146b22ce696c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.369702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 190/367] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:34.371426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:34.378489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68431a6-1c38-4851-af54-146b22ce696c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d68431a6-1c38-4851-af54-146b22ce696c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:34.387535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:34.388481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:34.389273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:34.391787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 178/368] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:34.392814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68431a6-1c38-4851-af54-146b22ce696c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:34.485971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ed8e-f94f-4fa7-8f75-c95cf41eee4d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:34.503705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68431a6-1c38-4851-af54-146b22ce696c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:34.519314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee091299-6ccb-4589-93ab-5601dde791d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:34.520247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee091299-6ccb-4589-93ab-5601dde791d9 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:34.520428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee091299-6ccb-4589-93ab-5601dde791d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:34.520699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee091299-6ccb-4589-93ab-5601dde791d9 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.521873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee091299-6ccb-4589-93ab-5601dde791d9 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:34.523327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee091299-6ccb-4589-93ab-5601dde791d9 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:34.525322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 191/369] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:34.525756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee091299-6ccb-4589-93ab-5601dde791d9 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:34.540640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8087b5-3e06-4d97-a76a-eabc1a9a1a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:34.542007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8087b5-3e06-4d97-a76a-eabc1a9a1a5d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:34.542541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8087b5-3e06-4d97-a76a-eabc1a9a1a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:34.543056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8087b5-3e06-4d97-a76a-eabc1a9a1a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.613929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8087b5-3e06-4d97-a76a-eabc1a9a1a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:34.615811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8087b5-3e06-4d97-a76a-eabc1a9a1a5d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:34.624341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee091299-6ccb-4589-93ab-5601dde791d9 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:34.659027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:34.659702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:34.659983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:34.660254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.661000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:34.661298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:34.662646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:34.672039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 192/370] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:34.672865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:34.721250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 179/371] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:34.722410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8087b5-3e06-4d97-a76a-eabc1a9a1a5d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:34.773733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f719-dd15-40ca-a4c5-e9e465198dc3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:34.809185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7bc3c-3abc-47d3-a6c3-e97e5fd48d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:34.810088 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7bc3c-3abc-47d3-a6c3-e97e5fd48d7e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:34.810366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7bc3c-3abc-47d3-a6c3-e97e5fd48d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:34.810718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7bc3c-3abc-47d3-a6c3-e97e5fd48d7e None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.811925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7bc3c-3abc-47d3-a6c3-e97e5fd48d7e None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:34.813423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7bc3c-3abc-47d3-a6c3-e97e5fd48d7e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:34.815372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 193/372] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:34.816217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7bc3c-3abc-47d3-a6c3-e97e5fd48d7e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:34.828733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8087b5-3e06-4d97-a76a-eabc1a9a1a5d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:34.864506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37683a7-6340-4527-b13f-2b9f8c03f407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:34.865528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37683a7-6340-4527-b13f-2b9f8c03f407 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:34.866058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37683a7-6340-4527-b13f-2b9f8c03f407 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:34.866534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37683a7-6340-4527-b13f-2b9f8c03f407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.915803 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7bc3c-3abc-47d3-a6c3-e97e5fd48d7e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:34.939158 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37683a7-6340-4527-b13f-2b9f8c03f407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:34.940921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37683a7-6340-4527-b13f-2b9f8c03f407 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:34.948281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43d83b-9a5d-47d0-9c0e-8763e03de4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:34.949262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43d83b-9a5d-47d0-9c0e-8763e03de4fc None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:34.949398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43d83b-9a5d-47d0-9c0e-8763e03de4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:34.949666 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43d83b-9a5d-47d0-9c0e-8763e03de4fc None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:34.951402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43d83b-9a5d-47d0-9c0e-8763e03de4fc None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:34.952818 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43d83b-9a5d-47d0-9c0e-8763e03de4fc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:34.954491 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 194/373] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:34.955261 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43d83b-9a5d-47d0-9c0e-8763e03de4fc None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:35.044023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 180/374] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:35.045529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37683a7-6340-4527-b13f-2b9f8c03f407 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:35.053771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43d83b-9a5d-47d0-9c0e-8763e03de4fc None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:35.088640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:35.089300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:35.089659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:35.089850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:35.090690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] RBAC: Adding query filter params (group.id=8c0a397a89c744a4b01f9e2e6ea60766, role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:35.091017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:35.093046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:35.098480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 195/375] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:34 2022] GET /identity/v3/role_assignments?group.id=8c0a397a89c744a4b01f9e2e6ea60766&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:35.099276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:35.150585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37683a7-6340-4527-b13f-2b9f8c03f407 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:35.188114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34327b34-b009-441b-81a8-f97d018bbc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:35.189353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327b34-b009-441b-81a8-f97d018bbc75 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:35.189852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327b34-b009-441b-81a8-f97d018bbc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:35.190331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327b34-b009-441b-81a8-f97d018bbc75 None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:35.191868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34327b34-b009-441b-81a8-f97d018bbc75 None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:35.193654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34327b34-b009-441b-81a8-f97d018bbc75 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:35.195703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 181/376] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:35 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:35.202231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34327b34-b009-441b-81a8-f97d018bbc75 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:35.220128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e69e4-b40d-47dd-92fa-9438fc064946 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:35.309382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c7ab-5064-4d83-ab3c-8b51c8a8225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:35.311321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c7ab-5064-4d83-ab3c-8b51c8a8225b None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:35.311823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c7ab-5064-4d83-ab3c-8b51c8a8225b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:35.312341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c7ab-5064-4d83-ab3c-8b51c8a8225b None admin] PATH_INFO: `/v3/projects/4f2ab0bb70f249b18504d9e6616306cf` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:35.314508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484c7ab-5064-4d83-ab3c-8b51c8a8225b None admin] RBAC: Authorizing `identity:get_project(project_id=4f2ab0bb70f249b18504d9e6616306cf)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:35.318126 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484c7ab-5064-4d83-ab3c-8b51c8a8225b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:35.323010 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 196/377] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:35 2022] GET /identity/v3/projects/4f2ab0bb70f249b18504d9e6616306cf => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:35.328872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c7ab-5064-4d83-ab3c-8b51c8a8225b None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:35.392009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34327b34-b009-441b-81a8-f97d018bbc75 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:35.434256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:35.435399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:35.437226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:35.437226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:35.437815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] RBAC: Adding query filter params (group.id=8c0a397a89c744a4b01f9e2e6ea60766, role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:35.438126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:35.440202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:35.447240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 182/378] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:35 2022] GET /identity/v3/role_assignments?group.id=8c0a397a89c744a4b01f9e2e6ea60766&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=a3a8307844964e028f49d8bcff278ded => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:35.501850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c7ab-5064-4d83-ab3c-8b51c8a8225b None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:35.558309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6e85-15c7-40d0-b327-8d2ae918c7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:35.559228 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6e85-15c7-40d0-b327-8d2ae918c7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:35.559512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6e85-15c7-40d0-b327-8d2ae918c7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:35.559787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6e85-15c7-40d0-b327-8d2ae918c7a3 None admin] PATH_INFO: `/v3/groups/27f82c2516fb436cb60a0f48dd67afd2` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:35.571815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda6e85-15c7-40d0-b327-8d2ae918c7a3 None admin] RBAC: Authorizing `identity:get_group(group_id=27f82c2516fb436cb60a0f48dd67afd2)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:35.573295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda6e85-15c7-40d0-b327-8d2ae918c7a3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:35.575379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 197/379] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:35 2022] GET /identity/v3/groups/27f82c2516fb436cb60a0f48dd67afd2 => generated 229 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:35.581115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:35.710421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26f662-aca9-4697-a777-1a282b2735d5 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:35.753214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68810ca8-1507-4d68-9981-4e40adc9a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:35.753872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810ca8-1507-4d68-9981-4e40adc9a960 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:35.754152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810ca8-1507-4d68-9981-4e40adc9a960 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:35.754425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810ca8-1507-4d68-9981-4e40adc9a960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:35.755278 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68810ca8-1507-4d68-9981-4e40adc9a960 None admin] RBAC: Adding query filter params (group.id=27f82c2516fb436cb60a0f48dd67afd2, role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=4f2ab0bb70f249b18504d9e6616306cf) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:35.755591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68810ca8-1507-4d68-9981-4e40adc9a960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:35.757020 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68810ca8-1507-4d68-9981-4e40adc9a960 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:35.765003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 183/380] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:35 2022] GET /identity/v3/role_assignments?group.id=27f82c2516fb436cb60a0f48dd67afd2&scope.project.id=4f2ab0bb70f249b18504d9e6616306cf&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:36.017683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f3fc-1c68-4c92-ae23-8f5715cb0b21 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:36.017993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f3fc-1c68-4c92-ae23-8f5715cb0b21 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:36.018175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f3fc-1c68-4c92-ae23-8f5715cb0b21 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:36.019718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 198/381] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:36.025704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7b24-cd75-4e33-8046-fda3d53b3098 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:36.026286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7b24-cd75-4e33-8046-fda3d53b3098 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:36.026780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b7b24-cd75-4e33-8046-fda3d53b3098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:36.047980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-de3b7b24-cd75-4e33-8046-fda3d53b3098 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:36.049712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-de3b7b24-cd75-4e33-8046-fda3d53b3098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:36.129632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 184/382] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:36.163122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62f3fc-1c68-4c92-ae23-8f5715cb0b21 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:36.300638 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62f3fc-1c68-4c92-ae23-8f5715cb0b21 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:36.344200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9996b-c959-498f-b815-d475ef7be0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:36.345007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9996b-c959-498f-b815-d475ef7be0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:36.345291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9996b-c959-498f-b815-d475ef7be0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:36.345566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9996b-c959-498f-b815-d475ef7be0c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:36.359982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9996b-c959-498f-b815-d475ef7be0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-3ba9996b-c959-498f-b815-d475ef7be0c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:36.368007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:36.368906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:36.370318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 199/383] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:36.375060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b7b24-cd75-4e33-8046-fda3d53b3098 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:36.530704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b7b24-cd75-4e33-8046-fda3d53b3098 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:36.574067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d39001-7e17-48de-ba08-02c88a9345ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:36.575136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39001-7e17-48de-ba08-02c88a9345ad None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:36.576184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39001-7e17-48de-ba08-02c88a9345ad None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:36.576660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39001-7e17-48de-ba08-02c88a9345ad None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:36.577632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d39001-7e17-48de-ba08-02c88a9345ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:36.578141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d39001-7e17-48de-ba08-02c88a9345ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:36.579764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d39001-7e17-48de-ba08-02c88a9345ad None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:36.594114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 185/384] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:36.599415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9996b-c959-498f-b815-d475ef7be0c9 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:36.618994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d7db-784d-462d-a7fd-59fdec36b07c None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:36.619614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d7db-784d-462d-a7fd-59fdec36b07c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:36.620093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914d7db-784d-462d-a7fd-59fdec36b07c None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:36.621958 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 186/385] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:36.627909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100c62-b633-4151-8e93-b36643dc8181 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:36.628455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100c62-b633-4151-8e93-b36643dc8181 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:36.628954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100c62-b633-4151-8e93-b36643dc8181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:36.654183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e4100c62-b633-4151-8e93-b36643dc8181 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:36.657013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e4100c62-b633-4151-8e93-b36643dc8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:36.731294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9996b-c959-498f-b815-d475ef7be0c9 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:36.769561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dda923-ba53-4e3e-aa6b-42d80fece1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:36.770427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dda923-ba53-4e3e-aa6b-42d80fece1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:36.770705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dda923-ba53-4e3e-aa6b-42d80fece1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:36.770989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dda923-ba53-4e3e-aa6b-42d80fece1b1 None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:36.773182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dda923-ba53-4e3e-aa6b-42d80fece1b1 None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:36.774611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dda923-ba53-4e3e-aa6b-42d80fece1b1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:36.776374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 200/386] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:36 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:36.782480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dda923-ba53-4e3e-aa6b-42d80fece1b1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:36.785826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 187/387] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:36.847464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4100c62-b633-4151-8e93-b36643dc8181 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:36.906720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dda923-ba53-4e3e-aa6b-42d80fece1b1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:36.951998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e9b18-1030-4b62-a555-e9675671524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:36.953317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9b18-1030-4b62-a555-e9675671524e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:36.953811 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9b18-1030-4b62-a555-e9675671524e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:36.954286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9b18-1030-4b62-a555-e9675671524e None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:36.955899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e9b18-1030-4b62-a555-e9675671524e None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:36.957533 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e9b18-1030-4b62-a555-e9675671524e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:36.960624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 201/388] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:36 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:36.966920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e9b18-1030-4b62-a555-e9675671524e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:37.013799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4100c62-b633-4151-8e93-b36643dc8181 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:37.053997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f1f90-031e-417a-9462-fd9f37aedb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:37.055301 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f1f90-031e-417a-9462-fd9f37aedb16 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:37.055774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f1f90-031e-417a-9462-fd9f37aedb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:37.056234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f1f90-031e-417a-9462-fd9f37aedb16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:37.076875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f1f90-031e-417a-9462-fd9f37aedb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-8a3f1f90-031e-417a-9462-fd9f37aedb16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:37.088424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:37.089291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:37.090097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:37.101257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 188/389] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:37.102372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f1f90-031e-417a-9462-fd9f37aedb16 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:37.144772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e9b18-1030-4b62-a555-e9675671524e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:37.200157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89282a-292a-4639-9752-013814b847cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:37.201466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89282a-292a-4639-9752-013814b847cc None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:37.201989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89282a-292a-4639-9752-013814b847cc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:37.202452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89282a-292a-4639-9752-013814b847cc None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/groups/8c0a397a89c744a4b01f9e2e6ea60766/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:37.205963 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89282a-292a-4639-9752-013814b847cc None admin] RBAC: Authorizing `identity:create_grant(project_id=97980c4bfe244a7dbd3d0f26a699c7c8, group_id=8c0a397a89c744a4b01f9e2e6ea60766, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:37.208724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89282a-292a-4639-9752-013814b847cc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:37.234952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 202/390] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 16:31:36 2022] PUT /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/groups/8c0a397a89c744a4b01f9e2e6ea60766/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:31:37.257117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f1f90-031e-417a-9462-fd9f37aedb16 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:37.299354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:37.300471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:37.300951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:37.301418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:37.302394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:37.302921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:37.304733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:37.315003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 189/391] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:37.320648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89282a-292a-4639-9752-013814b847cc None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:37.435250 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89282a-292a-4639-9752-013814b847cc None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:37.485035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b37095-d160-449a-a20e-7104d9f09383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:37.486306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37095-d160-449a-a20e-7104d9f09383 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:37.486763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37095-d160-449a-a20e-7104d9f09383 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:37.487232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b37095-d160-449a-a20e-7104d9f09383 None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:37.488738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b37095-d160-449a-a20e-7104d9f09383 None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:37.490445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b37095-d160-449a-a20e-7104d9f09383 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:37.492341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 203/392] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:37 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:37.498249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:37.616165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d27c4c-f9fd-4137-ac88-7b86295431c4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:37.649813 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc54fa-d9ad-44d8-80f3-6a1b7ec0db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:37.650684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc54fa-d9ad-44d8-80f3-6a1b7ec0db61 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:37.651023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc54fa-d9ad-44d8-80f3-6a1b7ec0db61 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:37.651260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc54fa-d9ad-44d8-80f3-6a1b7ec0db61 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:37.655698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc54fa-d9ad-44d8-80f3-6a1b7ec0db61 None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:37.657147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc54fa-d9ad-44d8-80f3-6a1b7ec0db61 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:37.659208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 190/393] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:37 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:37.664862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b37095-d160-449a-a20e-7104d9f09383 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:37.796520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b37095-d160-449a-a20e-7104d9f09383 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:37.840281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4fc6b-2006-415c-9048-f5e4109bcf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:37.841218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4fc6b-2006-415c-9048-f5e4109bcf84 None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:37.842001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4fc6b-2006-415c-9048-f5e4109bcf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:37.842271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4fc6b-2006-415c-9048-f5e4109bcf84 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/groups/8c0a397a89c744a4b01f9e2e6ea60766/roles/a3a8307844964e028f49d8bcff278ded` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:37.848887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4fc6b-2006-415c-9048-f5e4109bcf84 None admin] RBAC: Authorizing `identity:create_grant(project_id=97980c4bfe244a7dbd3d0f26a699c7c8, group_id=8c0a397a89c744a4b01f9e2e6ea60766, role_id=a3a8307844964e028f49d8bcff278ded)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:37.850338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4fc6b-2006-415c-9048-f5e4109bcf84 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:37.868628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 204/394] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 16:31:37 2022] PUT /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8/groups/8c0a397a89c744a4b01f9e2e6ea60766/roles/a3a8307844964e028f49d8bcff278ded => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:38.100786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8910-7a9e-4599-add0-7d531791bea3 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:38.101152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8910-7a9e-4599-add0-7d531791bea3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:38.101320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a8910-7a9e-4599-add0-7d531791bea3 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:38.102686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 191/395] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:38.116478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43019fc-2825-431d-97b7-3dfcaa6b0d52 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:38.116835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43019fc-2825-431d-97b7-3dfcaa6b0d52 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:38.117024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43019fc-2825-431d-97b7-3dfcaa6b0d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:38.137835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d43019fc-2825-431d-97b7-3dfcaa6b0d52 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:38.139757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d43019fc-2825-431d-97b7-3dfcaa6b0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:38.221057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 205/396] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:38.245334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8910-7a9e-4599-add0-7d531791bea3 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:38.332243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070952d-bcb6-4ed6-9cac-6b6a1517fe8a None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:38.332562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070952d-bcb6-4ed6-9cac-6b6a1517fe8a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:38.332804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070952d-bcb6-4ed6-9cac-6b6a1517fe8a None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:38.334401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 206/397] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:38.339657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a4961-9d9e-455a-b5bf-5f439993c08b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:38.339940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a4961-9d9e-455a-b5bf-5f439993c08b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:38.340212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a4961-9d9e-455a-b5bf-5f439993c08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:38.366412 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a8910-7a9e-4599-add0-7d531791bea3 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:38.366883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-0d3a4961-9d9e-455a-b5bf-5f439993c08b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:38.368110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0d3a4961-9d9e-455a-b5bf-5f439993c08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:38.405880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759f60-79e9-4272-a221-4d286bb346f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:38.406737 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759f60-79e9-4272-a221-4d286bb346f1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:38.407058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759f60-79e9-4272-a221-4d286bb346f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:38.407563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759f60-79e9-4272-a221-4d286bb346f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:38.419654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7759f60-79e9-4272-a221-4d286bb346f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-e7759f60-79e9-4272-a221-4d286bb346f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:38.428782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:38.429695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:38.430482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:38.431603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 192/398] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:38.440002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759f60-79e9-4272-a221-4d286bb346f1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:38.501613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 207/399] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:38.534089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a4961-9d9e-455a-b5bf-5f439993c08b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:38.552883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759f60-79e9-4272-a221-4d286bb346f1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:38.613140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:38.613937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:38.614238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:38.614511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:38.615289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:38.615595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:38.617025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:38.637763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 193/400] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:38.643169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:38.730278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a4961-9d9e-455a-b5bf-5f439993c08b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:38.792706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6dc0e-1548-4fd2-a7da-67eac34d9dfe None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:38.802093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1e2c-a84b-4962-b3f6-6c5429e7a2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:38.802909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1e2c-a84b-4962-b3f6-6c5429e7a2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:38.803214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1e2c-a84b-4962-b3f6-6c5429e7a2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:38.803484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1e2c-a84b-4962-b3f6-6c5429e7a2f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:38.820513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e1e2c-a84b-4962-b3f6-6c5429e7a2f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-2f2e1e2c-a84b-4962-b3f6-6c5429e7a2f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:38.834204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:38.835202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:38.836006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:38.837097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 208/401] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:38.841679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1e2c-a84b-4962-b3f6-6c5429e7a2f9 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:38.862114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9e3ef-bda0-41c0-aa81-a6c6051b753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:38.862995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9e3ef-bda0-41c0-aa81-a6c6051b753a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:38.863324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9e3ef-bda0-41c0-aa81-a6c6051b753a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:38.863638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9e3ef-bda0-41c0-aa81-a6c6051b753a None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:38.864893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9e3ef-bda0-41c0-aa81-a6c6051b753a None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:38.866453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9e3ef-bda0-41c0-aa81-a6c6051b753a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:38.868371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 194/402] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:38 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:38.873409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9e3ef-bda0-41c0-aa81-a6c6051b753a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:39.024243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9e3ef-bda0-41c0-aa81-a6c6051b753a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:39.061798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1e2c-a84b-4962-b3f6-6c5429e7a2f9 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:39.071298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21baa-e3f6-4830-a988-5e83beacccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:39.072169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21baa-e3f6-4830-a988-5e83beacccb0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.072446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21baa-e3f6-4830-a988-5e83beacccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.072718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21baa-e3f6-4830-a988-5e83beacccb0 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.073951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f21baa-e3f6-4830-a988-5e83beacccb0 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:39.075455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f21baa-e3f6-4830-a988-5e83beacccb0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:39.077465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 195/403] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:38 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:39.083895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21baa-e3f6-4830-a988-5e83beacccb0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:39.115148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:39.116174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.116680 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.117152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.118108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:39.118667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:39.120281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:39.129189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 209/404] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:39.134881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:39.237220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05512eea-11a7-4e28-a48e-95f8792d12d3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:39.242940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f21baa-e3f6-4830-a988-5e83beacccb0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:39.271116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679d022-8a93-4b85-a5c6-a5b50edb9b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:39.272314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679d022-8a93-4b85-a5c6-a5b50edb9b2e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.272795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679d022-8a93-4b85-a5c6-a5b50edb9b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.273265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679d022-8a93-4b85-a5c6-a5b50edb9b2e None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.276648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679d022-8a93-4b85-a5c6-a5b50edb9b2e None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:39.279207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679d022-8a93-4b85-a5c6-a5b50edb9b2e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:39.281803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3f93c-c1b0-4d61-9430-6133be701185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:39.282676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f93c-c1b0-4d61-9430-6133be701185 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.282954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f93c-c1b0-4d61-9430-6133be701185 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.283249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f93c-c1b0-4d61-9430-6133be701185 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/groups/8c0a397a89c744a4b01f9e2e6ea60766/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.284727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 210/405] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:39 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:39.285950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a568b-1d27-4972-90ed-548d6751faab None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.286228 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a568b-1d27-4972-90ed-548d6751faab None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.286502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a568b-1d27-4972-90ed-548d6751faab None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.287749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 211/406] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:39.288427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a568b-1d27-4972-90ed-548d6751faab None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:39.289445 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3f93c-c1b0-4d61-9430-6133be701185 None admin] RBAC: Authorizing `identity:create_grant(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a, group_id=8c0a397a89c744a4b01f9e2e6ea60766, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:39.290993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3f93c-c1b0-4d61-9430-6133be701185 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:39.308522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 196/407] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 16:31:39 2022] PUT /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/groups/8c0a397a89c744a4b01f9e2e6ea60766/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:39.315146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857927c5-26d0-4477-816e-8be123a155fc None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.315146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857927c5-26d0-4477-816e-8be123a155fc None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.315146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857927c5-26d0-4477-816e-8be123a155fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.330691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-857927c5-26d0-4477-816e-8be123a155fc None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:39.332264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-857927c5-26d0-4477-816e-8be123a155fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:39.413610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 197/408] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:39.442219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857927c5-26d0-4477-816e-8be123a155fc None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:39.534640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a568b-1d27-4972-90ed-548d6751faab None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:39.567673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857927c5-26d0-4477-816e-8be123a155fc None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:39.603197 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef702f8-f415-48b4-adf2-d18d1779dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:39.604059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef702f8-f415-48b4-adf2-d18d1779dc95 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.604413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef702f8-f415-48b4-adf2-d18d1779dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.604608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef702f8-f415-48b4-adf2-d18d1779dc95 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.605845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef702f8-f415-48b4-adf2-d18d1779dc95 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:39.607344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef702f8-f415-48b4-adf2-d18d1779dc95 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:39.613819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 212/409] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:39 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:39.615001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef702f8-f415-48b4-adf2-d18d1779dc95 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:39.617539 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9137d-7bdf-4fc3-b1ca-3759c02c5568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:39.620149 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9137d-7bdf-4fc3-b1ca-3759c02c5568 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.620660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9137d-7bdf-4fc3-b1ca-3759c02c5568 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.621132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9137d-7bdf-4fc3-b1ca-3759c02c5568 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.635491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9137d-7bdf-4fc3-b1ca-3759c02c5568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-3dd9137d-7bdf-4fc3-b1ca-3759c02c5568 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:39.645177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:39.646152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:39.646998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:39.649789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 198/410] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:39.655450 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9137d-7bdf-4fc3-b1ca-3759c02c5568 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:39.767781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9137d-7bdf-4fc3-b1ca-3759c02c5568 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:39.805539 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:39.806558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.807067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.807540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.809515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:39.810586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:39.812213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:39.822183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 199/411] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:39.831312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:39.851335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef702f8-f415-48b4-adf2-d18d1779dc95 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:39.913232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f19dc-8b16-4a48-9792-4565d117ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:39.914106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f19dc-8b16-4a48-9792-4565d117ff67 None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:39.914382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f19dc-8b16-4a48-9792-4565d117ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:39.914647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f19dc-8b16-4a48-9792-4565d117ff67 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/groups/8c0a397a89c744a4b01f9e2e6ea60766/roles/a3a8307844964e028f49d8bcff278ded` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:39.916881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f19dc-8b16-4a48-9792-4565d117ff67 None admin] RBAC: Authorizing `identity:create_grant(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a, group_id=8c0a397a89c744a4b01f9e2e6ea60766, role_id=a3a8307844964e028f49d8bcff278ded)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:39.918294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f19dc-8b16-4a48-9792-4565d117ff67 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:39.933208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 213/412] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 16:31:39 2022] PUT /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a/groups/8c0a397a89c744a4b01f9e2e6ea60766/roles/a3a8307844964e028f49d8bcff278ded => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:31:39.959646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fbc48-1e6f-4d1e-9284-ae68986fbbd6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:40.000865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd98df7-7c72-4b7f-ba51-8fe2a146270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:40.002237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98df7-7c72-4b7f-ba51-8fe2a146270c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.002740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98df7-7c72-4b7f-ba51-8fe2a146270c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.003299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98df7-7c72-4b7f-ba51-8fe2a146270c None admin] PATH_INFO: `/v3/groups/27f82c2516fb436cb60a0f48dd67afd2` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.004940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd98df7-7c72-4b7f-ba51-8fe2a146270c None admin] RBAC: Authorizing `identity:get_group(group_id=27f82c2516fb436cb60a0f48dd67afd2)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:40.006642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd98df7-7c72-4b7f-ba51-8fe2a146270c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:40.010265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 200/413] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:39 2022] GET /identity/v3/groups/27f82c2516fb436cb60a0f48dd67afd2 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:40.014766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f19dc-8b16-4a48-9792-4565d117ff67 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:40.158750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f19dc-8b16-4a48-9792-4565d117ff67 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:40.210836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d8eb-fd36-4cae-897d-be0bb240be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:40.211752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d8eb-fd36-4cae-897d-be0bb240be63 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.212030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d8eb-fd36-4cae-897d-be0bb240be63 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.212301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d8eb-fd36-4cae-897d-be0bb240be63 None admin] PATH_INFO: `/v3/projects/4f2ab0bb70f249b18504d9e6616306cf` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.213594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d8eb-fd36-4cae-897d-be0bb240be63 None admin] RBAC: Authorizing `identity:get_project(project_id=4f2ab0bb70f249b18504d9e6616306cf)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:40.215120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d8eb-fd36-4cae-897d-be0bb240be63 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:40.217368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 214/414] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:40 2022] GET /identity/v3/projects/4f2ab0bb70f249b18504d9e6616306cf => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:40.222852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd98df7-7c72-4b7f-ba51-8fe2a146270c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:40.353715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd98df7-7c72-4b7f-ba51-8fe2a146270c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:40.394504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd532949-f4c0-459a-9233-2a7327c45863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:40.395460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd532949-f4c0-459a-9233-2a7327c45863 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.395719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd532949-f4c0-459a-9233-2a7327c45863 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.395996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd532949-f4c0-459a-9233-2a7327c45863 None admin] PATH_INFO: `/v3/projects/4f2ab0bb70f249b18504d9e6616306cf/groups/27f82c2516fb436cb60a0f48dd67afd2/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.398006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd532949-f4c0-459a-9233-2a7327c45863 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f2ab0bb70f249b18504d9e6616306cf, group_id=27f82c2516fb436cb60a0f48dd67afd2, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:40.399498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd532949-f4c0-459a-9233-2a7327c45863 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:40.417370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 201/415] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 16:31:40 2022] PUT /identity/v3/projects/4f2ab0bb70f249b18504d9e6616306cf/groups/27f82c2516fb436cb60a0f48dd67afd2/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:31:40.469370 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02bcd-24f9-4091-bb01-6993de26d233 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.469705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02bcd-24f9-4091-bb01-6993de26d233 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.469925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02bcd-24f9-4091-bb01-6993de26d233 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.471705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 215/416] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:40.477174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a49b-29b3-4a99-ac32-322fcf93adda None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.477456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a49b-29b3-4a99-ac32-322fcf93adda None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.477732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a49b-29b3-4a99-ac32-322fcf93adda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.499393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-7418a49b-29b3-4a99-ac32-322fcf93adda None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:40.500636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7418a49b-29b3-4a99-ac32-322fcf93adda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:40.604532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 202/417] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:40.644355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02bcd-24f9-4091-bb01-6993de26d233 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:40.753378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02bcd-24f9-4091-bb01-6993de26d233 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:40.790657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0b4a6-8086-4a48-9f29-d8b876289ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:40.791776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0b4a6-8086-4a48-9f29-d8b876289ebe None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.792236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0b4a6-8086-4a48-9f29-d8b876289ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.792704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0b4a6-8086-4a48-9f29-d8b876289ebe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.803701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0b4a6-8086-4a48-9f29-d8b876289ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-e8c0b4a6-8086-4a48-9f29-d8b876289ebe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:40.811956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:40.812860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:40.813664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:40.816121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 216/418] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:40.822005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418a49b-29b3-4a99-ac32-322fcf93adda None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:40.867874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c75589-302f-45d8-9840-2d7e7f44e772 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.868718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c75589-302f-45d8-9840-2d7e7f44e772 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.869173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c75589-302f-45d8-9840-2d7e7f44e772 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.870676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 217/419] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:40.882586 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4104f6-2d65-496a-b800-f29957029b68 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.882586 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4104f6-2d65-496a-b800-f29957029b68 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.882586 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4104f6-2d65-496a-b800-f29957029b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.916435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fe4104f6-2d65-496a-b800-f29957029b68 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:40.917229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fe4104f6-2d65-496a-b800-f29957029b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:40.945671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418a49b-29b3-4a99-ac32-322fcf93adda None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:40.984557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:40.985823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:40.986342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:40.987429 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:40.988389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:40.989387 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:40.991459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:41.000311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 203/420] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:41.007997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:41.042444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 218/421] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:41.130534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4104f6-2d65-496a-b800-f29957029b68 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:41.144866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99aed-1c46-463a-85ce-86ef08de6557 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:41.182774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc3028-e1dd-4d87-8be5-2871e9afa8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:41.183447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3028-e1dd-4d87-8be5-2871e9afa8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:41.183725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3028-e1dd-4d87-8be5-2871e9afa8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:41.183997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc3028-e1dd-4d87-8be5-2871e9afa8c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:41.306215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc3028-e1dd-4d87-8be5-2871e9afa8c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:41.307628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc3028-e1dd-4d87-8be5-2871e9afa8c2 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:41.320689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4104f6-2d65-496a-b800-f29957029b68 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:41.386948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864244e-507b-493b-9210-8d2dfd1ef529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:41.387781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864244e-507b-493b-9210-8d2dfd1ef529 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:41.388609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864244e-507b-493b-9210-8d2dfd1ef529 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:41.388881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864244e-507b-493b-9210-8d2dfd1ef529 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:41.410566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864244e-507b-493b-9210-8d2dfd1ef529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-d864244e-507b-493b-9210-8d2dfd1ef529 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:41.418633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:41.419852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:41.420642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 219/422] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:41.428696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864244e-507b-493b-9210-8d2dfd1ef529 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:41.502691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 204/423] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:41.509744 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc3028-e1dd-4d87-8be5-2871e9afa8c2 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:41.571092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864244e-507b-493b-9210-8d2dfd1ef529 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:41.613306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:41.613973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:41.614253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:41.614581 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:41.615361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:41.615665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:41.617029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:41.630793 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 220/424] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:41.639885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:41.712713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc3028-e1dd-4d87-8be5-2871e9afa8c2 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:41.758574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06646284-d926-481f-bff6-9784bcd68ac1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:41.770288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d90751-0509-4dff-b5d1-7ba5d751d515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:41.771173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d90751-0509-4dff-b5d1-7ba5d751d515 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:41.771448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d90751-0509-4dff-b5d1-7ba5d751d515 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:41.771715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d90751-0509-4dff-b5d1-7ba5d751d515 None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:41.775671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d90751-0509-4dff-b5d1-7ba5d751d515 None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:41.777117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d90751-0509-4dff-b5d1-7ba5d751d515 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:41.779455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 205/425] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:41 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:41.786168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d90751-0509-4dff-b5d1-7ba5d751d515 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:41.799870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069bb66-ce4c-423f-820d-ef00a7ce0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:41.800812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bb66-ce4c-423f-820d-ef00a7ce0e4c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:41.801298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bb66-ce4c-423f-820d-ef00a7ce0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:41.801796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bb66-ce4c-423f-820d-ef00a7ce0e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:41.877742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069bb66-ce4c-423f-820d-ef00a7ce0e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:41.879988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069bb66-ce4c-423f-820d-ef00a7ce0e4c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:41.978085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d90751-0509-4dff-b5d1-7ba5d751d515 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.006390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 221/426] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:42.018494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069bb66-ce4c-423f-820d-ef00a7ce0e4c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:42.044653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876f575-2360-4e7e-b436-798568477f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:42.045852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f575-2360-4e7e-b436-798568477f2e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.046336 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f575-2360-4e7e-b436-798568477f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.046834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f575-2360-4e7e-b436-798568477f2e None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.048283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876f575-2360-4e7e-b436-798568477f2e None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:42.050129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876f575-2360-4e7e-b436-798568477f2e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:42.052026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 206/427] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:41 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:42.058033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3c697-488a-437d-83f5-c70959de61ef None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.058738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3c697-488a-437d-83f5-c70959de61ef None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.059246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3c697-488a-437d-83f5-c70959de61ef None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.062224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 207/428] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:42.063918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3c697-488a-437d-83f5-c70959de61ef None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:42.150061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069bb66-ce4c-423f-820d-ef00a7ce0e4c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.167466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3c697-488a-437d-83f5-c70959de61ef None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.193634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f5853-09f9-43df-b9ab-df2d7944f27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:42.194992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5853-09f9-43df-b9ab-df2d7944f27e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.195485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5853-09f9-43df-b9ab-df2d7944f27e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.195977 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5853-09f9-43df-b9ab-df2d7944f27e None admin] PATH_INFO: `/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.197468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f5853-09f9-43df-b9ab-df2d7944f27e None admin] RBAC: Authorizing `identity:get_project(project_id=97980c4bfe244a7dbd3d0f26a699c7c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:42.199148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f5853-09f9-43df-b9ab-df2d7944f27e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:42.204959 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:42.205819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.206226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.206401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 222/429] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:42 2022] GET /identity/v3/projects/97980c4bfe244a7dbd3d0f26a699c7c8 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:42.206668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.207844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] RBAC: Adding query filter params (group.id=8c0a397a89c744a4b01f9e2e6ea60766, role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:42.208160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:42.208654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995a676-6581-458d-9064-c7e663173dbd None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.209157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995a676-6581-458d-9064-c7e663173dbd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.209590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:42.209885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995a676-6581-458d-9064-c7e663173dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.217264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 208/430] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:42 2022] GET /identity/v3/role_assignments?group.id=8c0a397a89c744a4b01f9e2e6ea60766&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:42.218053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:42.239305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e995a676-6581-458d-9064-c7e663173dbd None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:42.240920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e995a676-6581-458d-9064-c7e663173dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:42.332442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cd98c-69eb-4c9c-964d-205d1409a84f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.371826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea2bd9-d40e-419b-9880-07bafcb0174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:42.373644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2bd9-d40e-419b-9880-07bafcb0174d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.374082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2bd9-d40e-419b-9880-07bafcb0174d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.374588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2bd9-d40e-419b-9880-07bafcb0174d None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.375972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea2bd9-d40e-419b-9880-07bafcb0174d None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:42.376082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 223/431] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:42.377748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea2bd9-d40e-419b-9880-07bafcb0174d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:42.380031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 209/432] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:42 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:42.385962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995a676-6581-458d-9064-c7e663173dbd None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:42.411988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea2bd9-d40e-419b-9880-07bafcb0174d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:42.534016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea2bd9-d40e-419b-9880-07bafcb0174d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.570102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995a676-6581-458d-9064-c7e663173dbd None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.573927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a01a9-6d93-4421-b73c-1d655568084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:42.574735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a01a9-6d93-4421-b73c-1d655568084f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.575038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a01a9-6d93-4421-b73c-1d655568084f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.575348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a01a9-6d93-4421-b73c-1d655568084f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.588477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a01a9-6d93-4421-b73c-1d655568084f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-3d3a01a9-6d93-4421-b73c-1d655568084f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:42.598860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:42.599987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:31:42.600970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:42.603316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 210/433] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:42.609770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a01a9-6d93-4421-b73c-1d655568084f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:42.619855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39c42b-d23a-4de4-a037-9728d6643bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:42.620848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c42b-d23a-4de4-a037-9728d6643bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.621341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c42b-d23a-4de4-a037-9728d6643bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.621837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c42b-d23a-4de4-a037-9728d6643bd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.622908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39c42b-d23a-4de4-a037-9728d6643bd2 None admin] RBAC: Adding query filter params (group.id=8c0a397a89c744a4b01f9e2e6ea60766, role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:42.623479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39c42b-d23a-4de4-a037-9728d6643bd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:42.625139 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39c42b-d23a-4de4-a037-9728d6643bd2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:42.633248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 224/434] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:42 2022] GET /identity/v3/role_assignments?group.id=8c0a397a89c744a4b01f9e2e6ea60766&scope.project.id=97980c4bfe244a7dbd3d0f26a699c7c8&role.id=a3a8307844964e028f49d8bcff278ded => generated 611 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:42.645249 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a430d4-3f16-4d98-a96e-fd096ea120fe None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.645867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a430d4-3f16-4d98-a96e-fd096ea120fe None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.646373 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a430d4-3f16-4d98-a96e-fd096ea120fe None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.648111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 225/435] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:42.654409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe43bd2-2f5c-4597-8744-e6fdb93f82dd None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.655113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe43bd2-2f5c-4597-8744-e6fdb93f82dd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.655598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe43bd2-2f5c-4597-8744-e6fdb93f82dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.680361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fbe43bd2-2f5c-4597-8744-e6fdb93f82dd None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:42.682046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fbe43bd2-2f5c-4597-8744-e6fdb93f82dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:42.739512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a01a9-6d93-4421-b73c-1d655568084f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.774045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 226/436] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:42.790849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:42.791957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.792465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.792945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.793930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] RBAC: Adding query filter params (name=member) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:42.795305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:42.796973 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:42.802319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe43bd2-2f5c-4597-8744-e6fdb93f82dd None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:42.816148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 211/437] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:31:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:42.822722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:42.944636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe43bd2-2f5c-4597-8744-e6fdb93f82dd None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.960370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46180-c0f4-4801-866c-e99d0a995828 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:42.981717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b11eb-a923-4423-9195-e253f5d468e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:42.982531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b11eb-a923-4423-9195-e253f5d468e8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:42.982813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b11eb-a923-4423-9195-e253f5d468e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:42.983127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b11eb-a923-4423-9195-e253f5d468e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:42.994519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b11eb-a923-4423-9195-e253f5d468e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:42.999994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01bb8-36ef-435c-a004-f8f4bc7ce560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.000782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01bb8-36ef-435c-a004-f8f4bc7ce560 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.001059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01bb8-36ef-435c-a004-f8f4bc7ce560 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.001328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01bb8-36ef-435c-a004-f8f4bc7ce560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-552b11eb-a923-4423-9195-e253f5d468e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:43.003507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:43.004429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:43.005243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 227/438] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:43.010343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b11eb-a923-4423-9195-e253f5d468e8 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.081225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e01bb8-36ef-435c-a004-f8f4bc7ce560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.082699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e01bb8-36ef-435c-a004-f8f4bc7ce560 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.123356 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b11eb-a923-4423-9195-e253f5d468e8 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.159083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3087a3-b279-4604-b2ca-770c03ebbb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.159756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3087a3-b279-4604-b2ca-770c03ebbb1f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.160037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3087a3-b279-4604-b2ca-770c03ebbb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.160309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3087a3-b279-4604-b2ca-770c03ebbb1f None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.161059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3087a3-b279-4604-b2ca-770c03ebbb1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:43.161365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3087a3-b279-4604-b2ca-770c03ebbb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.162728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3087a3-b279-4604-b2ca-770c03ebbb1f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.171333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 228/439] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:43.173031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196508a0-5220-4090-83a2-c296cd22b49a None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.173318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196508a0-5220-4090-83a2-c296cd22b49a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.173590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196508a0-5220-4090-83a2-c296cd22b49a None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.174949 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 229/440] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:43.179854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196508a0-5220-4090-83a2-c296cd22b49a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.198039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 212/441] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:43.199270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46872d-1ddb-4e7f-9386-e09add051fc8 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.199558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46872d-1ddb-4e7f-9386-e09add051fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.199837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46872d-1ddb-4e7f-9386-e09add051fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.218701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-8f46872d-1ddb-4e7f-9386-e09add051fc8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:43.219913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8f46872d-1ddb-4e7f-9386-e09add051fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:43.282354 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196508a0-5220-4090-83a2-c296cd22b49a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 213/442] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:43.285515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46872d-1ddb-4e7f-9386-e09add051fc8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.317972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708bb2d-48c9-4970-a3fe-26896c7a01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.318611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708bb2d-48c9-4970-a3fe-26896c7a01c5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.318887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708bb2d-48c9-4970-a3fe-26896c7a01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.319194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708bb2d-48c9-4970-a3fe-26896c7a01c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.377920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46872d-1ddb-4e7f-9386-e09add051fc8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.381813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708bb2d-48c9-4970-a3fe-26896c7a01c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.383273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708bb2d-48c9-4970-a3fe-26896c7a01c5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.409595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c9170-b43e-4f86-bf3e-cddff528aaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.410448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9170-b43e-4f86-bf3e-cddff528aaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.410731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9170-b43e-4f86-bf3e-cddff528aaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.411034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c9170-b43e-4f86-bf3e-cddff528aaf1 None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.412209 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c9170-b43e-4f86-bf3e-cddff528aaf1 None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.413631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c9170-b43e-4f86-bf3e-cddff528aaf1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.415349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 214/443] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:43.416167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c9170-b43e-4f86-bf3e-cddff528aaf1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.474383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 230/444] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:31:43.475234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708bb2d-48c9-4970-a3fe-26896c7a01c5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.510164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c9170-b43e-4f86-bf3e-cddff528aaf1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.542476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da425-5b26-4593-ad42-6fcc7b77bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.543274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da425-5b26-4593-ad42-6fcc7b77bb3f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.543550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da425-5b26-4593-ad42-6fcc7b77bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.543818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da425-5b26-4593-ad42-6fcc7b77bb3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.553740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61da425-5b26-4593-ad42-6fcc7b77bb3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-c61da425-5b26-4593-ad42-6fcc7b77bb3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:43.562095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:43.563054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:43.563849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 215/445] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:43.564503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da425-5b26-4593-ad42-6fcc7b77bb3f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.572682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708bb2d-48c9-4970-a3fe-26896c7a01c5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.610439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50c41-790d-42e6-a783-96093c7516d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.611313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50c41-790d-42e6-a783-96093c7516d1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.611594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50c41-790d-42e6-a783-96093c7516d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.611876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e50c41-790d-42e6-a783-96093c7516d1 None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.613041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e50c41-790d-42e6-a783-96093c7516d1 None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.614477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e50c41-790d-42e6-a783-96093c7516d1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.616142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 231/446] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:43.616888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50c41-790d-42e6-a783-96093c7516d1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.659007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da425-5b26-4593-ad42-6fcc7b77bb3f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.690814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3f1b-aa74-49fa-8e36-1a9c69556f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.691706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3f1b-aa74-49fa-8e36-1a9c69556f5f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.691989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3f1b-aa74-49fa-8e36-1a9c69556f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.692265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3f1b-aa74-49fa-8e36-1a9c69556f5f None admin] PATH_INFO: `/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.693451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e3f1b-aa74-49fa-8e36-1a9c69556f5f None admin] RBAC: Authorizing `identity:get_project(project_id=7924bd4a1cd34eff92fadb6cfadd7e1a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.694894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e3f1b-aa74-49fa-8e36-1a9c69556f5f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.696581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 216/447] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/projects/7924bd4a1cd34eff92fadb6cfadd7e1a => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:43.697333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3f1b-aa74-49fa-8e36-1a9c69556f5f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.713255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e50c41-790d-42e6-a783-96093c7516d1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.745293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.745888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.746172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.746444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.747266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:43.748083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.749456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.757375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 232/448] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:43.757960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.793235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3f1b-aa74-49fa-8e36-1a9c69556f5f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.828051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.828786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.829076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.829352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.830182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] RBAC: Adding query filter params (group.id=8c0a397a89c744a4b01f9e2e6ea60766, role.id=6ec804c74dad4bf8847c06a34d95505a, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:43.830496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.831962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.837706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 217/449] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/role_assignments?group.id=8c0a397a89c744a4b01f9e2e6ea60766&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=6ec804c74dad4bf8847c06a34d95505a => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:43.838310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.851976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c667-a734-4efc-ab13-5603dc449067 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.888582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b57899-1324-4ff8-8a5b-2482b2a64475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.889457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b57899-1324-4ff8-8a5b-2482b2a64475 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.889739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b57899-1324-4ff8-8a5b-2482b2a64475 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.890013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b57899-1324-4ff8-8a5b-2482b2a64475 None admin] PATH_INFO: `/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:43.891273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b57899-1324-4ff8-8a5b-2482b2a64475 None admin] RBAC: Authorizing `identity:get_group(group_id=8c0a397a89c744a4b01f9e2e6ea60766)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:43.892731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b57899-1324-4ff8-8a5b-2482b2a64475 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:43.894424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 233/450] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/groups/8c0a397a89c744a4b01f9e2e6ea60766 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:43.900390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b57899-1324-4ff8-8a5b-2482b2a64475 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:43.948720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13998b4d-6e03-4f64-ba4c-b09f04009228 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:43.983153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcc1eb-ccc2-4518-85e5-ff582df84206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:43.983799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc1eb-ccc2-4518-85e5-ff582df84206 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:43.984080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc1eb-ccc2-4518-85e5-ff582df84206 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:43.984356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc1eb-ccc2-4518-85e5-ff582df84206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:44.004731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b57899-1324-4ff8-8a5b-2482b2a64475 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:44.039725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:44.040388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:44.040671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:44.040945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:44.041778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] RBAC: Adding query filter params (group.id=8c0a397a89c744a4b01f9e2e6ea60766, role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:44.042088 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:44.043987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:44.054268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 234/451] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/role_assignments?group.id=8c0a397a89c744a4b01f9e2e6ea60766&scope.project.id=7924bd4a1cd34eff92fadb6cfadd7e1a&role.id=a3a8307844964e028f49d8bcff278ded => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:44.056789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcc1eb-ccc2-4518-85e5-ff582df84206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:44.058268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcc1eb-ccc2-4518-85e5-ff582df84206 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:44.173289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 218/452] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:44.178932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:44.291107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1251739-1870-4b3e-a901-e349a5521bd4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:44.323736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f619730-e7d5-44b2-9b4c-a9515fcb23a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:44.324596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f619730-e7d5-44b2-9b4c-a9515fcb23a5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:44.324884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f619730-e7d5-44b2-9b4c-a9515fcb23a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:44.325161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f619730-e7d5-44b2-9b4c-a9515fcb23a5 None admin] PATH_INFO: `/v3/projects/4f2ab0bb70f249b18504d9e6616306cf` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:44.326381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f619730-e7d5-44b2-9b4c-a9515fcb23a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4f2ab0bb70f249b18504d9e6616306cf)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:44.327835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f619730-e7d5-44b2-9b4c-a9515fcb23a5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:44.329585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 235/453] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:31:44 2022] GET /identity/v3/projects/4f2ab0bb70f249b18504d9e6616306cf => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:44.335282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcc1eb-ccc2-4518-85e5-ff582df84206 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:44.431565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcc1eb-ccc2-4518-85e5-ff582df84206 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:44.463091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5bfe-3711-43cf-87c7-7a6edc6309f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:44.463943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5bfe-3711-43cf-87c7-7a6edc6309f2 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:44.464220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5bfe-3711-43cf-87c7-7a6edc6309f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:44.464489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5bfe-3711-43cf-87c7-7a6edc6309f2 None admin] PATH_INFO: `/v3/groups/27f82c2516fb436cb60a0f48dd67afd2` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:44.465630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d5bfe-3711-43cf-87c7-7a6edc6309f2 None admin] RBAC: Authorizing `identity:get_group(group_id=27f82c2516fb436cb60a0f48dd67afd2)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:44.467758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d5bfe-3711-43cf-87c7-7a6edc6309f2 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:44.469337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 219/454] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 16:31:44 2022] GET /identity/v3/groups/27f82c2516fb436cb60a0f48dd67afd2 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:44.475097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f619730-e7d5-44b2-9b4c-a9515fcb23a5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:44.566699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f619730-e7d5-44b2-9b4c-a9515fcb23a5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:44.598766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48c541-b8d0-4c4d-ab83-9ac747ebd5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:44.599433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c541-b8d0-4c4d-ab83-9ac747ebd5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:44.599717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c541-b8d0-4c4d-ab83-9ac747ebd5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:44.599992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c541-b8d0-4c4d-ab83-9ac747ebd5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:44.600816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48c541-b8d0-4c4d-ab83-9ac747ebd5b4 None admin] RBAC: Adding query filter params (group.id=27f82c2516fb436cb60a0f48dd67afd2, role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=4f2ab0bb70f249b18504d9e6616306cf) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:44.601128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48c541-b8d0-4c4d-ab83-9ac747ebd5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:44.602543 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48c541-b8d0-4c4d-ab83-9ac747ebd5b4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:44.608062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 236/455] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 16:31:44 2022] GET /identity/v3/role_assignments?group.id=27f82c2516fb436cb60a0f48dd67afd2&scope.project.id=4f2ab0bb70f249b18504d9e6616306cf&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:47.306433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884fb00-0a62-4cc7-b26b-16a86a4e2872 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.307466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884fb00-0a62-4cc7-b26b-16a86a4e2872 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.307946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884fb00-0a62-4cc7-b26b-16a86a4e2872 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.309799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 220/456] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:47.315263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab987-e5ae-472e-ad25-de48c7f33ba9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.316046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab987-e5ae-472e-ad25-de48c7f33ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.316527 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab987-e5ae-472e-ad25-de48c7f33ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.337089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-9adab987-e5ae-472e-ad25-de48c7f33ba9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:47.338652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9adab987-e5ae-472e-ad25-de48c7f33ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:47.432983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 237/457] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:47.449582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b472eb-2cd0-4421-880a-cd2d43e4ca92 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.450886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b472eb-2cd0-4421-880a-cd2d43e4ca92 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.451407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b472eb-2cd0-4421-880a-cd2d43e4ca92 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.453073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 221/458] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:47.459285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181646b-5558-41e9-9a33-46d5a0318f18 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.459884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181646b-5558-41e9-9a33-46d5a0318f18 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.460352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181646b-5558-41e9-9a33-46d5a0318f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.483957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c181646b-5558-41e9-9a33-46d5a0318f18 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:47.485488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c181646b-5558-41e9-9a33-46d5a0318f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:47.504128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b472eb-2cd0-4421-880a-cd2d43e4ca92 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:47.571924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 238/459] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:47.608015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181646b-5558-41e9-9a33-46d5a0318f18 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:47.668215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b472eb-2cd0-4421-880a-cd2d43e4ca92 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:47.714733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbaa17-5bab-421f-b236-e357ca23c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:47.716695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbaa17-5bab-421f-b236-e357ca23c474 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.717117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbaa17-5bab-421f-b236-e357ca23c474 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.717983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbaa17-5bab-421f-b236-e357ca23c474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.730683 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbaa17-5bab-421f-b236-e357ca23c474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:47.734177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbaa17-5bab-421f-b236-e357ca23c474 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:47.750688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181646b-5558-41e9-9a33-46d5a0318f18 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-2bfbaa17-5bab-421f-b236-e357ca23c474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:47.758776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:47.759674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:47.760499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:47.760499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:47.760499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:47.760499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:47.763948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 222/460] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:47.765575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647b3fe-2665-4cc7-b292-57d582f3e0b7 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.765860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647b3fe-2665-4cc7-b292-57d582f3e0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.766134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647b3fe-2665-4cc7-b292-57d582f3e0b7 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.771300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 223/461] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:47.772261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647b3fe-2665-4cc7-b292-57d582f3e0b7 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:47.799871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed817488-fe2e-4b8a-83e0-9c37c2c5c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:47.800875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817488-fe2e-4b8a-83e0-9c37c2c5c8ae None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.801153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817488-fe2e-4b8a-83e0-9c37c2c5c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.801423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817488-fe2e-4b8a-83e0-9c37c2c5c8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.817267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed817488-fe2e-4b8a-83e0-9c37c2c5c8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:47.819125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed817488-fe2e-4b8a-83e0-9c37c2c5c8ae None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-ed817488-fe2e-4b8a-83e0-9c37c2c5c8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:47.843053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:47.843902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:47.845143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:47.845143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:47.845143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:47.845143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:47.845143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 239/462] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:47.845411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc7882-5ab3-4a0c-b73c-eb6838ab6017 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.850155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc7882-5ab3-4a0c-b73c-eb6838ab6017 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.850155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc7882-5ab3-4a0c-b73c-eb6838ab6017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.873348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-53bc7882-5ab3-4a0c-b73c-eb6838ab6017 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:47.875346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-53bc7882-5ab3-4a0c-b73c-eb6838ab6017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:47.884152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647b3fe-2665-4cc7-b292-57d582f3e0b7 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:47.919032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:47.920085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:47.920830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:47.921253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:47.922212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:47.922723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:47.924378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:47.944910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 224/463] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:47.946154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:47.970850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 240/464] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:47.972091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc7882-5ab3-4a0c-b73c-eb6838ab6017 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:48.067584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b553-d0c1-4681-8a01-6f24fa1e7d57 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:48.083437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc7882-5ab3-4a0c-b73c-eb6838ab6017 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:48.102150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:48.103265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.103728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.104185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.105141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:48.105709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:48.107788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:48.117501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8fba2-5f98-45c4-99ce-6458ace16e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:48.118354 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fba2-5f98-45c4-99ce-6458ace16e2c None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.118795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fba2-5f98-45c4-99ce-6458ace16e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.119242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fba2-5f98-45c4-99ce-6458ace16e2c None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.120080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8fba2-5f98-45c4-99ce-6458ace16e2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:48.120202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 225/465] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:48.120897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:48.121979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8fba2-5f98-45c4-99ce-6458ace16e2c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:48.151186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 241/466] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:47 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:48.152734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7192e-2e4a-42ed-9d14-196b3cc474a0 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.153026 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7192e-2e4a-42ed-9d14-196b3cc474a0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.153362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7192e-2e4a-42ed-9d14-196b3cc474a0 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.155995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 242/467] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:48.161063 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7192e-2e4a-42ed-9d14-196b3cc474a0 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:48.248404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324d1a5-c851-4d1e-8691-be94ce9d9365 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:48.289027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea76598-d3ba-4c59-a773-c699a459ccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:48.289910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea76598-d3ba-4c59-a773-c699a459ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.290197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea76598-d3ba-4c59-a773-c699a459ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.290474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea76598-d3ba-4c59-a773-c699a459ccb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.302524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea76598-d3ba-4c59-a773-c699a459ccb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:48.304052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea76598-d3ba-4c59-a773-c699a459ccb6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:48.306829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7192e-2e4a-42ed-9d14-196b3cc474a0 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-8ea76598-d3ba-4c59-a773-c699a459ccb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:48.323996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:48.325297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:48.326186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:48.326186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:48.326186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:48.326186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:48.330502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 226/468] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:48.332834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa38e-5a00-4774-8167-84ea5d9e57b5 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.332834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa38e-5a00-4774-8167-84ea5d9e57b5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.332834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa38e-5a00-4774-8167-84ea5d9e57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.346774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d584d6-6bb0-4b07-8beb-46e4a6bfa800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:48.347530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d584d6-6bb0-4b07-8beb-46e4a6bfa800 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.347784 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d584d6-6bb0-4b07-8beb-46e4a6bfa800 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.348055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d584d6-6bb0-4b07-8beb-46e4a6bfa800 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.348767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d584d6-6bb0-4b07-8beb-46e4a6bfa800 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:48.350266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d584d6-6bb0-4b07-8beb-46e4a6bfa800 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:48.353711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-2a0fa38e-5a00-4774-8167-84ea5d9e57b5 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:48.354869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-2a0fa38e-5a00-4774-8167-84ea5d9e57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:48.375121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 243/469] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:48 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:48.375939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d584d6-6bb0-4b07-8beb-46e4a6bfa800 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:48.446574 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 227/470] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:48.474563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fa38e-5a00-4774-8167-84ea5d9e57b5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:48.492151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d584d6-6bb0-4b07-8beb-46e4a6bfa800 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:48.534561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:48.535742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.536225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.536693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.537661 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:48.538194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:48.539878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:48.555591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 244/471] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:48.564343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:48.616719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fa38e-5a00-4774-8167-84ea5d9e57b5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:48.663392 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715521-0933-4129-ae09-b02113e303cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:48.664205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715521-0933-4129-ae09-b02113e303cf None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.664485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715521-0933-4129-ae09-b02113e303cf None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.664756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715521-0933-4129-ae09-b02113e303cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.683337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51715521-0933-4129-ae09-b02113e303cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:48.685155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51715521-0933-4129-ae09-b02113e303cf None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:48.699110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901b59f-390f-432b-8b9b-309b6e13188e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-51715521-0933-4129-ae09-b02113e303cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:48.708577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:48.709424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:48.710250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:48.710250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:48.710250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:48.710250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:48.713050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 228/472] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:48.719957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715521-0933-4129-ae09-b02113e303cf None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:48.738672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44208159-63a5-4770-a1ab-4ed9975bfce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:48.739370 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208159-63a5-4770-a1ab-4ed9975bfce0 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.739647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208159-63a5-4770-a1ab-4ed9975bfce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.739915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208159-63a5-4770-a1ab-4ed9975bfce0 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.740659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44208159-63a5-4770-a1ab-4ed9975bfce0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:48.742162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44208159-63a5-4770-a1ab-4ed9975bfce0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:48.770988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 245/473] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:48 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:48.770988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15e0b-e303-438a-804e-d85c496a18e5 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.770988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15e0b-e303-438a-804e-d85c496a18e5 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.770988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15e0b-e303-438a-804e-d85c496a18e5 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.771505 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 246/474] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:48.777870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e8be-25c7-4a09-84c2-53974c31c085 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.778151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e8be-25c7-4a09-84c2-53974c31c085 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.779000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e8be-25c7-4a09-84c2-53974c31c085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.802225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e1a2e8be-25c7-4a09-84c2-53974c31c085 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:48.803636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e1a2e8be-25c7-4a09-84c2-53974c31c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:48.867122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715521-0933-4129-ae09-b02113e303cf None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:48.928784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:48.929744 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:48.930030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:48.930310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:48.931098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:48.931413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:48.932834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:48.946436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 229/475] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:48.949618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 247/476] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:48.952743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:48.979712 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e8be-25c7-4a09-84c2-53974c31c085 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:49.076303 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc254bc-509d-431e-bde4-8d93f1613866 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:49.087726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e8be-25c7-4a09-84c2-53974c31c085 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:49.126121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121053c0-f1b9-4aab-ba89-580f68c63684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:49.126760 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121053c0-f1b9-4aab-ba89-580f68c63684 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:49.127076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121053c0-f1b9-4aab-ba89-580f68c63684 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:49.127353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121053c0-f1b9-4aab-ba89-580f68c63684 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:49.127764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:49.128137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121053c0-f1b9-4aab-ba89-580f68c63684 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:49.128556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:49.128906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:49.129264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:49.129592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121053c0-f1b9-4aab-ba89-580f68c63684 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:49.130133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:49.131612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:49.139853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.sql.core [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 16:31:49.139853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 16:31:49.139853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [parameters: {'id': 'f48b439d7f7b4768ac305b0ea17178bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 16:31:49.139853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81322) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 16:31:49.152589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 230/477] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:48 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application conn.query(q) May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result.read() May 10 16:31:49.162629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return ref.to_dict() May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:31:49.163696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application next(self.gen) May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application yield resource May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application next(self.gen) May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.session.rollback() May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.force_reraise() May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise self.value May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application session.commit() May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 16:31:49.164605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._prepare_impl() May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.session.flush() May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._flush(objects) May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application compat.raise_( May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application flush_context.execute() May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rec.execute(self) May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 16:31:49.165477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:31:49.166364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application conn.query(q) May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result.read() May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:31:49.167346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [parameters: {'id': 'f48b439d7f7b4768ac305b0ea17178bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:49.168583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 16:31:49.169970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:49.170986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 248/478] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 16:31:48 2022] POST /identity/v3/roles => generated 144 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:49.178983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121053c0-f1b9-4aab-ba89-580f68c63684 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:49.292341 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121053c0-f1b9-4aab-ba89-580f68c63684 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:49.338577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3243020-2d34-49cf-bfab-e50a3810d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:49.339473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3243020-2d34-49cf-bfab-e50a3810d331 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:49.339756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3243020-2d34-49cf-bfab-e50a3810d331 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:49.340033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3243020-2d34-49cf-bfab-e50a3810d331 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:49.355444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3243020-2d34-49cf-bfab-e50a3810d331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-b3243020-2d34-49cf-bfab-e50a3810d331 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:49.363885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:49.365918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:49.366986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 231/479] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:31:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:49.370821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:49.479511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7322a-dbb6-4977-952c-69e8378698af None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:49.514606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861a5c7-40d1-4dcf-a032-1d85926755d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:49.515321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a5c7-40d1-4dcf-a032-1d85926755d4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:49.515604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a5c7-40d1-4dcf-a032-1d85926755d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:49.515880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a5c7-40d1-4dcf-a032-1d85926755d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:49.516636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a5c7-40d1-4dcf-a032-1d85926755d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:49.517062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a5c7-40d1-4dcf-a032-1d85926755d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:49.518765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a5c7-40d1-4dcf-a032-1d85926755d4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:49.527562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 249/480] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:51.039274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8571d6-e47e-4397-9fb4-c201acaa2b86 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.040017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8571d6-e47e-4397-9fb4-c201acaa2b86 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.040017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8571d6-e47e-4397-9fb4-c201acaa2b86 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.041399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 232/481] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:51.045066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9eccd-9885-4031-a2cf-bc6e5b367167 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.045538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9eccd-9885-4031-a2cf-bc6e5b367167 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.045702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9eccd-9885-4031-a2cf-bc6e5b367167 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.047179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 250/482] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:51.051620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf3d2d-fb83-48c8-b45b-22a456a0835f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.051901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf3d2d-fb83-48c8-b45b-22a456a0835f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.052168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf3d2d-fb83-48c8-b45b-22a456a0835f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.053360 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aaeab-23ff-44ec-94c2-176f5775c62d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.053632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aaeab-23ff-44ec-94c2-176f5775c62d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.053901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aaeab-23ff-44ec-94c2-176f5775c62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.079023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-aabf3d2d-fb83-48c8-b45b-22a456a0835f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:51.080525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-aabf3d2d-fb83-48c8-b45b-22a456a0835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:51.083059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-573aaeab-23ff-44ec-94c2-176f5775c62d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:51.084199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-573aaeab-23ff-44ec-94c2-176f5775c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:51.182945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 233/483] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:31:51.209409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 251/484] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:51.218557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf3d2d-fb83-48c8-b45b-22a456a0835f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:51.232415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573aaeab-23ff-44ec-94c2-176f5775c62d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:51.372625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf3d2d-fb83-48c8-b45b-22a456a0835f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:51.373412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573aaeab-23ff-44ec-94c2-176f5775c62d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:51.410606 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab329c6d-e8ac-4a93-8027-25316b0d349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:51.411570 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689ab1d-8b39-492e-8350-4d64a925282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:51.412618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689ab1d-8b39-492e-8350-4d64a925282f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.413614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329c6d-e8ac-4a93-8027-25316b0d349e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.414122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689ab1d-8b39-492e-8350-4d64a925282f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.414598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329c6d-e8ac-4a93-8027-25316b0d349e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.415286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329c6d-e8ac-4a93-8027-25316b0d349e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.415686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689ab1d-8b39-492e-8350-4d64a925282f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.435840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab329c6d-e8ac-4a93-8027-25316b0d349e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:51.436634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689ab1d-8b39-492e-8350-4d64a925282f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ab329c6d-e8ac-4a93-8027-25316b0d349e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:51.444773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:51.445671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:51.446468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-f689ab1d-8b39-492e-8350-4d64a925282f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:51.456258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:51.457141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:51.457933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:51.460600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 252/485] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:51.462029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 234/486] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:51.468022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689ab1d-8b39-492e-8350-4d64a925282f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:51.468948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab329c6d-e8ac-4a93-8027-25316b0d349e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:51.568405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab329c6d-e8ac-4a93-8027-25316b0d349e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:51.570007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689ab1d-8b39-492e-8350-4d64a925282f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:51.605829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:51.606517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.606802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.607107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.608543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:51.608859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:51.610260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:51.611701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:51.612374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.612653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.612924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.613672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:51.613977 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:51.615376 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:51.628966 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 253/487] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:31:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:51.635759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 235/488] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:31:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:51.635922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:51.642057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:51.743125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af964fe-dafd-4d43-85a9-3edbdbfe5307 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:51.791424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:51.792250 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.792542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.792819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.793959 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c868836-4882-42ab-b384-de46e60da3ee None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:51.817415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:51.818881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:51.836043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:51.837089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:51.837514 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:51.837928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:51.840751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:51.841757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:51.842816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:51.842816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:51.842816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:51.842816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:51.842816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 254/489] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:51.848077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:51.854203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:51.855855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:51.883616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:51.884592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:51.885433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:51.885433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:51.885433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:51.885433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:51.894736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 236/490] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:51.895685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:51.998849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10452f-1664-4942-ae50-0fc4be092200 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.027463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93c45f-0a28-42ab-aaa2-45298698bae7 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.040057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251c54-b0bb-445b-af20-1e946ade98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.040783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251c54-b0bb-445b-af20-1e946ade98fc None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.041071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251c54-b0bb-445b-af20-1e946ade98fc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.041349 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251c54-b0bb-445b-af20-1e946ade98fc None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.042077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251c54-b0bb-445b-af20-1e946ade98fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:52.042384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251c54-b0bb-445b-af20-1e946ade98fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:52.043783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251c54-b0bb-445b-af20-1e946ade98fc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:52.057050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 255/491] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:52.058371 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f161-165e-4dfa-abb8-cf41a0100196 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.058662 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f161-165e-4dfa-abb8-cf41a0100196 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.058938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f161-165e-4dfa-abb8-cf41a0100196 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.061022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 256/492] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:52.062593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f161-165e-4dfa-abb8-cf41a0100196 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.071621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f968ac-7d60-4437-a0d7-dc07902e7664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.072294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f968ac-7d60-4437-a0d7-dc07902e7664 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.072584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f968ac-7d60-4437-a0d7-dc07902e7664 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.072856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f968ac-7d60-4437-a0d7-dc07902e7664 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.073588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f968ac-7d60-4437-a0d7-dc07902e7664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:52.073892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f968ac-7d60-4437-a0d7-dc07902e7664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:52.075516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f968ac-7d60-4437-a0d7-dc07902e7664 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:52.087697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 237/493] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:52.089044 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67ac3-48a4-421e-91f3-bf4b56af37e8 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.089329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67ac3-48a4-421e-91f3-bf4b56af37e8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.089605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67ac3-48a4-421e-91f3-bf4b56af37e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.105934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1cb67ac3-48a4-421e-91f3-bf4b56af37e8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:52.107662 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1cb67ac3-48a4-421e-91f3-bf4b56af37e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:52.170761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f161-165e-4dfa-abb8-cf41a0100196 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.173568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 238/494] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:52.174482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb67ac3-48a4-421e-91f3-bf4b56af37e8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.205809 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af174fa9-ec22-4032-ae53-7bd93f02f0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.206608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174fa9-ec22-4032-ae53-7bd93f02f0dc None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.206886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174fa9-ec22-4032-ae53-7bd93f02f0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.207193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af174fa9-ec22-4032-ae53-7bd93f02f0dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.214124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af174fa9-ec22-4032-ae53-7bd93f02f0dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:52.215601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af174fa9-ec22-4032-ae53-7bd93f02f0dc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-af174fa9-ec22-4032-ae53-7bd93f02f0dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:31:52.232286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:52.233258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:52.234140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 257/495] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:52.235262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373acc5e-b2b9-46d0-aded-057c631ccba0 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.235262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373acc5e-b2b9-46d0-aded-057c631ccba0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.235428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373acc5e-b2b9-46d0-aded-057c631ccba0 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.240529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 258/496] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:52.240529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373acc5e-b2b9-46d0-aded-057c631ccba0 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.287426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb67ac3-48a4-421e-91f3-bf4b56af37e8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.324458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.325310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.325577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.325838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.334049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:52.335526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:52.342511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373acc5e-b2b9-46d0-aded-057c631ccba0 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:31:52.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:52.352891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 16:31:52.354002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:52.358067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 239/497] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:52.358873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.380296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb41507-eaa0-4def-a76e-9a3d250f0e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.381298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb41507-eaa0-4def-a76e-9a3d250f0e41 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.381730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb41507-eaa0-4def-a76e-9a3d250f0e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.382003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb41507-eaa0-4def-a76e-9a3d250f0e41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.392242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb41507-eaa0-4def-a76e-9a3d250f0e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-edb41507-eaa0-4def-a76e-9a3d250f0e41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:52.400321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:52.401222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:52.402025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 259/498] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:52.403709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab33a3-3d02-48ee-aaeb-9023793dc70b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.403709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab33a3-3d02-48ee-aaeb-9023793dc70b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.403877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab33a3-3d02-48ee-aaeb-9023793dc70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.420817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-efab33a3-3d02-48ee-aaeb-9023793dc70b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:52.421981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-efab33a3-3d02-48ee-aaeb-9023793dc70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:52.458011 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01043a04-4203-4395-9d60-0948aee59ee2 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.490418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 260/499] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:52.491273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab33a3-3d02-48ee-aaeb-9023793dc70b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.499776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.500455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.501095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.501379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.502232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:52.502541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:52.504037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:52.539723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 240/500] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:52.540473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.583814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab33a3-3d02-48ee-aaeb-9023793dc70b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.616148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb25e76-94f6-4e33-bf72-358567321a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.616810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25e76-94f6-4e33-bf72-358567321a7c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.617090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25e76-94f6-4e33-bf72-358567321a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.617362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25e76-94f6-4e33-bf72-358567321a7c None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.618199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb25e76-94f6-4e33-bf72-358567321a7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:52.618508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb25e76-94f6-4e33-bf72-358567321a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:52.620013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb25e76-94f6-4e33-bf72-358567321a7c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:52.635507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda6526-b385-446c-8da7-f36bdeb90a5c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.655097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 261/501] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:52.656403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948053a0-6f9b-4fe6-818c-52255b4c7b07 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.656698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948053a0-6f9b-4fe6-818c-52255b4c7b07 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.656976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948053a0-6f9b-4fe6-818c-52255b4c7b07 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.658351 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 262/502] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:52.658890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948053a0-6f9b-4fe6-818c-52255b4c7b07 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.670311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.670988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.671283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.671559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.672306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:52.672613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:52.673991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:52.681715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 241/503] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:52.682631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.755790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948053a0-6f9b-4fe6-818c-52255b4c7b07 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.773687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602afe7-97a4-49c7-9c0c-ed89012fff78 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.787819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588529-ca1f-4f3c-9728-226f6f3be970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.788602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588529-ca1f-4f3c-9728-226f6f3be970 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.788884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588529-ca1f-4f3c-9728-226f6f3be970 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.789156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588529-ca1f-4f3c-9728-226f6f3be970 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.799040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27588529-ca1f-4f3c-9728-226f6f3be970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:52.805578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6d959-8e4b-4e90-8810-b659ff352a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.806211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6d959-8e4b-4e90-8810-b659ff352a55 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.806494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6d959-8e4b-4e90-8810-b659ff352a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-27588529-ca1f-4f3c-9728-226f6f3be970 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:52.806695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:52.807710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:52.813463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:52.814073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6d959-8e4b-4e90-8810-b659ff352a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.814142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 263/504] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:52.814142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588529-ca1f-4f3c-9728-226f6f3be970 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:52.884477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6d959-8e4b-4e90-8810-b659ff352a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:52.885938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6d959-8e4b-4e90-8810-b659ff352a55 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:52.907328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588529-ca1f-4f3c-9728-226f6f3be970 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:52.938231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f24ff-6f64-495e-893a-ba81e2e243b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:52.938869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f24ff-6f64-495e-893a-ba81e2e243b5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.939181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f24ff-6f64-495e-893a-ba81e2e243b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.939457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f24ff-6f64-495e-893a-ba81e2e243b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.977672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 242/505] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:52.978931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f876c0-e332-44b6-bf20-b237462f8d38 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:52.979242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f876c0-e332-44b6-bf20-b237462f8d38 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:52.979519 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f876c0-e332-44b6-bf20-b237462f8d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:52.994579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-66f876c0-e332-44b6-bf20-b237462f8d38 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:52.995780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-66f876c0-e332-44b6-bf20-b237462f8d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:53.009898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f24ff-6f64-495e-893a-ba81e2e243b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.011376 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f24ff-6f64-495e-893a-ba81e2e243b5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.057438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 243/506] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:53.058182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f876c0-e332-44b6-bf20-b237462f8d38 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.104082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 264/507] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:53.104907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f24ff-6f64-495e-893a-ba81e2e243b5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.163938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f876c0-e332-44b6-bf20-b237462f8d38 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.195571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.196361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.196643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.196923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.197727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f24ff-6f64-495e-893a-ba81e2e243b5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.207103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.208553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:53.225427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:53.226250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:53.227122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:53.227122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:53.227122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.227122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:53.227122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 244/508] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:53.227789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.229574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.230231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.230599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.230875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.231675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:53.231976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.233331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.240995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 265/509] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:53.241756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.321726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1714a-db9e-4fd9-aa2d-4f4b2995a81c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.332654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d01d9-c930-4425-b024-d0b688c49dc5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.352883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.353679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.353948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.354224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.362858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.363652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.363927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.364201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.364295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.365650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.374669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.376144 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:53.382592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:53.383460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:53.384293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:53.384293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:53.384293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.384293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:53.384293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 245/510] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:53.384558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:53.396922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:53.397830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:53.398671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:53.398671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:53.398671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.398671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:53.398671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 266/511] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:53.398952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.482527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae4b77-9614-47ff-a801-272a184c6c41 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.490379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2487ee-0788-40f0-bcfb-7282e5fcda04 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.513642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.514428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.514709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.515011 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.521430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.522063 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.522345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.522617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.523363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:53.523666 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.525020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.525126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.526495 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.536690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 267/512] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:53.537454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:53.543180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:53.545016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:53.550405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:53.550405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:53.550405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.550405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:53.550405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 246/513] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:53.550405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.630113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c30bd-3642-44b2-9d8c-034c8b2aeebe None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.638893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097e00-b5a6-4a24-b08a-8b1375f2d503 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.660767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.661540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.661817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.662091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.670379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.671043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.671323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.671596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.672306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.672416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:53.672608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.673719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.673950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.685572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 247/514] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:53.686348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:53.691226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:53.692115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:53.692948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:53.692948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:53.692948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:53.692948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:53.692948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 268/515] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:53.693787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.776984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012ffae-43d2-4b9e-a33c-eedcec606e05 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.783947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8a3a3-846d-426b-96bf-065fadd047f8 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.808459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.809106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.809382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.810214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.810924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:53.811255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.812604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.816711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.817496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.817778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.818049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.823086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 248/516] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:53.823854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.825227 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.826650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:31:53.841606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:53.842514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 269/517] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:53.843821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.916424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ea1da-f7f4-4718-b4f5-30ab9ac59b40 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.938431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41238d-afb5-4890-a4af-93f4b9974b19 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:53.947645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.948293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.948571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.948842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.949556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:53.949855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.951276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.962178 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 249/518] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:53.962948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:53.975400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:53.976189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:53.976473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:53.976746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:53.983893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:53.985315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:31:53.999300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:54.000130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:54.000947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 270/519] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:54.001406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.063458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb169c2-cd47-470e-8026-f2afb0c57406 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.094984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.095670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.095948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.096188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f43d41-29ca-48a1-9e83-415e16a6f4d2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.096283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.096914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:54.097214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.098575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.109686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 250/520] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:54.110453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.132656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea5416-1522-4088-ba5c-6751f9f42286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.133371 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5416-1522-4088-ba5c-6751f9f42286 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.133788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5416-1522-4088-ba5c-6751f9f42286 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.134258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5416-1522-4088-ba5c-6751f9f42286 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.134997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea5416-1522-4088-ba5c-6751f9f42286 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.136932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea5416-1522-4088-ba5c-6751f9f42286 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.157609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 271/521] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:31:54 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:31:54.158430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea5416-1522-4088-ba5c-6751f9f42286 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.213019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dc170-257f-4363-a98a-809da81e58d1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.249960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.250672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.250953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.251253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.252592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:54.252907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.254374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.270084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea5416-1522-4088-ba5c-6751f9f42286 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.279502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 251/522] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:54.279502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.305685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.306494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.306774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.307075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.314290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.315820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:31:54.331348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:54.332288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:54.333122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 272/523] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:54.333583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.391375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64554f8-81e1-42f0-9937-712eabc61fe9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.425059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.425724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.426005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.426359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.427097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:54.427409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.428847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.445113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ef7a2-5ff2-4018-b4e4-5479d05b3dff None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.451192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 252/524] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:54.451192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.478725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.479561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.479840 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.480109 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.487239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.488677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:31:54.503195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:54.504290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 273/525] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:54.505181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.554728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c248b-2951-406f-b547-e4ed5bff7c16 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.591938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca255747-99e1-4912-8875-c35835fe0d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.592584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255747-99e1-4912-8875-c35835fe0d41 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.592865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255747-99e1-4912-8875-c35835fe0d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.593144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255747-99e1-4912-8875-c35835fe0d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.601404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf3248-9e62-4ad9-8081-33257ced52d4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.633955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.634616 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.634899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.635205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.635996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:54.636309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.638294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.655819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 274/526] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:54.656899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.661589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca255747-99e1-4912-8875-c35835fe0d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.663297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca255747-99e1-4912-8875-c35835fe0d41 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.754247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3686f9-5128-4c9f-9064-90d909fcaffd None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.773436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 253/527] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:54.773436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca255747-99e1-4912-8875-c35835fe0d41 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.787645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.788303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.788589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.788868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.789703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=3d11d338bf2c4521bdfddc5d5c8da899) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:54.790055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.791483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.806990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 275/528] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/role_assignments?user.id=3d11d338bf2c4521bdfddc5d5c8da899&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:54.806990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.895683 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca255747-99e1-4912-8875-c35835fe0d41 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.915466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0fd28-feae-4b97-b71e-6227e0a49fb8 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:54.932824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.933663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.934042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.934949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.935985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:54.936398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.937975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.953270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:54.953945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:54.954228 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:54.954505 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:54.955406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=039df81163264994a86fe2e98bb96983) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:54.955724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:54.957192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:54.958586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 254/529] 10.222.0.57 () {56 vars in 1139 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:54.959556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:54.968674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 276/530] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/role_assignments?user.id=039df81163264994a86fe2e98bb96983&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:54.969539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:55.106990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26b61-a4db-4650-b9fc-dec8e66eb5a0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:55.145290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9619e-20d0-4e2c-81db-71cec554b96a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:55.147528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:55.148344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:55.148626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:55.148898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:55.164758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:55.166315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:55.187819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:55.188700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:55.189531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:55.189531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:55.189531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:55.189531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:55.189531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 255/531] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:55.194614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:55.196863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6f550-bc5c-41b9-b7ee-d7bc10f6651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:55.197514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f550-bc5c-41b9-b7ee-d7bc10f6651f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:55.197804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f550-bc5c-41b9-b7ee-d7bc10f6651f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:55.198052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f550-bc5c-41b9-b7ee-d7bc10f6651f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:55.266490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6f550-bc5c-41b9-b7ee-d7bc10f6651f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:55.267971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6f550-bc5c-41b9-b7ee-d7bc10f6651f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:55.294792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886566ba-d46f-4cf0-b869-f1c129f0817d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:55.331185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:55.331860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:55.332141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:55.332416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:55.333155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:55.333461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:55.334855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:55.347798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 256/532] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:55.353030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:55.369124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 277/533] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:55.375971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6f550-bc5c-41b9-b7ee-d7bc10f6651f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:55.453210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89551435-874a-4cfb-a3fb-770f60657052 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:55.487390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:55.488189 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:55.488470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:55.488747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:55.495572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:55.497127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:31:55.511914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:55.513980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:55.516004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 257/534] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:55.520440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:55.569102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6f550-bc5c-41b9-b7ee-d7bc10f6651f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:55.628537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb6b69-d4a1-48cb-855b-1d78a07fc27f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:55.655012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:55.656099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:55.656602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:55.657104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:55.664382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:55.665344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:55.665636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:55.665913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:55.666711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:55.667052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:55.668488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:55.680835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:55.682084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 258/535] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:31:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:55.682788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:55.687807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:55.723064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:55.723932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:55.724768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:55.724768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:55.724768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:55.724768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:55.726820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 278/536] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:55.732378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:55.796864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd9c9d-059b-4ce7-b6f9-c80eb48db488 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:55.834231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:55.834891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:55.838991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:55.838991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:55.838991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=c789864ed513471fb6b367aecf236828) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:55.838991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:55.838991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:55.845776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 259/537] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:55 2022] GET /identity/v3/role_assignments?user.id=c789864ed513471fb6b367aecf236828&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:55.936612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e0fa2-1663-4ab5-821a-fee30fdd55f0 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:55.998618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:55.999679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:56.000161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:56.000630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:56.001598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:56.002106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:56.003741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:56.020968 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 279/538] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:56.026216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:56.146198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56067c44-6fc6-4cbc-8a3b-eb896c2a262f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:56.184218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:56.185562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:56.185840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:56.186110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:56.193091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:56.194539 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:31:56.209545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:56.210434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:56.211322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 260/539] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:56.216627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:56.318358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3650-a3be-4e13-8e5b-22092d8211cf None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:56.363765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72371b6-c744-4b53-831e-1f13332d2190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:56.364456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72371b6-c744-4b53-831e-1f13332d2190 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:56.364743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72371b6-c744-4b53-831e-1f13332d2190 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:56.365022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72371b6-c744-4b53-831e-1f13332d2190 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:56.369929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72371b6-c744-4b53-831e-1f13332d2190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:56.369929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72371b6-c744-4b53-831e-1f13332d2190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:56.369929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72371b6-c744-4b53-831e-1f13332d2190 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:56.395001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 280/540] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:31:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:56.414991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:56.576607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf54a5-9b08-4623-8a00-34b50d961b89 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:56.607874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1d72d-0d51-4030-8bb9-132bd643bdcd None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:56.608234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1d72d-0d51-4030-8bb9-132bd643bdcd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:56.608439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1d72d-0d51-4030-8bb9-132bd643bdcd None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:56.609865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 281/541] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:31:56.615590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aedbc-da3a-4a7b-ac32-66ec6f6ae085 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:56.615938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aedbc-da3a-4a7b-ac32-66ec6f6ae085 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:56.616179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aedbc-da3a-4a7b-ac32-66ec6f6ae085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:56.644929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:56.645601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:56.645884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:56.646161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:56.647026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=05b1227b7f36498e8c1f1e27fa0ccb46) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:56.647342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:56.648795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:56.658995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ce7aedbc-da3a-4a7b-ac32-66ec6f6ae085 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:56.660207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ce7aedbc-da3a-4a7b-ac32-66ec6f6ae085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:56.662750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 261/542] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:56 2022] GET /identity/v3/role_assignments?user.id=05b1227b7f36498e8c1f1e27fa0ccb46&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:56.820700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 282/543] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:56.860544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:57.029779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506abe1-6b00-4491-9092-2561c9c42ebb None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:57.099134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade05d1-f4b9-4a21-b73e-a270afd840de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:57.099949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade05d1-f4b9-4a21-b73e-a270afd840de None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:57.100232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade05d1-f4b9-4a21-b73e-a270afd840de None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:57.100508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade05d1-f4b9-4a21-b73e-a270afd840de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:57.118382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade05d1-f4b9-4a21-b73e-a270afd840de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-6ade05d1-f4b9-4a21-b73e-a270afd840de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:57.126733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:57.127678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:57.128465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 262/544] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:57.136124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aedbc-da3a-4a7b-ac32-66ec6f6ae085 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:57.273080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aedbc-da3a-4a7b-ac32-66ec6f6ae085 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:57.307413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:57.308465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:57.308940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:57.309478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:57.310920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:57.311445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:57.313019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:57.321796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 283/545] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:31:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:57.327157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade05d1-f4b9-4a21-b73e-a270afd840de None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:57.473132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade05d1-f4b9-4a21-b73e-a270afd840de None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:57.520760 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3e9be-729d-4d9b-973e-39c41542a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:57.521587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e9be-729d-4d9b-973e-39c41542a3dc None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:57.521871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e9be-729d-4d9b-973e-39c41542a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:57.522145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3e9be-729d-4d9b-973e-39c41542a3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:57.539855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3e9be-729d-4d9b-973e-39c41542a3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:57.541331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3e9be-729d-4d9b-973e-39c41542a3dc None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-89b3e9be-729d-4d9b-973e-39c41542a3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:57.563890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:57.564784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:57.565617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:57.565617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:57.565617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:57.565617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:57.565617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 263/546] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:57.570791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:57.694537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d751cde-6221-4c0e-9107-bd2dc17e72f7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:57.716619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516348-c127-41ec-ab37-c98ae9d1b064 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:57.716921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516348-c127-41ec-ab37-c98ae9d1b064 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:57.717183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516348-c127-41ec-ab37-c98ae9d1b064 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:57.722486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 264/547] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:57.723995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693173-f12a-4ecc-a692-30ed9e81594d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:57.724335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693173-f12a-4ecc-a692-30ed9e81594d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:57.724931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693173-f12a-4ecc-a692-30ed9e81594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:57.729609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:57.730436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:57.730935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:57.732025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:57.732890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:57.733324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:57.734812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:57.744693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-da693173-f12a-4ecc-a692-30ed9e81594d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:57.745923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-da693173-f12a-4ecc-a692-30ed9e81594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:57.747473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 284/548] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:57.756946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:57.874570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 265/549] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:57.911816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693173-f12a-4ecc-a692-30ed9e81594d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:57.917936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60bc57-c21e-4f90-8add-8f8941a85b89 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:57.964140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:57.964935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:57.965212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:57.965482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:57.976782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:57.979311 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:31:58.007476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:58.008426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:58.009310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 285/550] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:31:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:31:58.017058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.118749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e87acb-74eb-424a-a1b5-7cd3b12ae93d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:58.139030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693173-f12a-4ecc-a692-30ed9e81594d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:58.154153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49e8c3-2b2b-4cdc-9ea1-60d29e8ec069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:58.154815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49e8c3-2b2b-4cdc-9ea1-60d29e8ec069 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.155121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49e8c3-2b2b-4cdc-9ea1-60d29e8ec069 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.155395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49e8c3-2b2b-4cdc-9ea1-60d29e8ec069 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.156370 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49e8c3-2b2b-4cdc-9ea1-60d29e8ec069 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:58.156756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49e8c3-2b2b-4cdc-9ea1-60d29e8ec069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:58.158404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49e8c3-2b2b-4cdc-9ea1-60d29e8ec069 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:58.177302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 286/551] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:31:58.178689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd82486-433a-429a-8f2f-7ff4a74b5615 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.178994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd82486-433a-429a-8f2f-7ff4a74b5615 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.179275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd82486-433a-429a-8f2f-7ff4a74b5615 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.179903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed119-e09d-466f-b4f3-f19a36992cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:58.180709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 287/552] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:58.180831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed119-e09d-466f-b4f3-f19a36992cff None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.181135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed119-e09d-466f-b4f3-f19a36992cff None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.181472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed119-e09d-466f-b4f3-f19a36992cff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.187748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7d8a-45a1-4ee9-a357-0490414f5d63 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.188031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7d8a-45a1-4ee9-a357-0490414f5d63 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.188304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7d8a-45a1-4ee9-a357-0490414f5d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.196433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ed119-e09d-466f-b4f3-f19a36992cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:58.206098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7b7d7d8a-45a1-4ee9-a357-0490414f5d63 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-2d2ed119-e09d-466f-b4f3-f19a36992cff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:58.206876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:58.207756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:58.208541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:58.209170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7b7d7d8a-45a1-4ee9-a357-0490414f5d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:58.210676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 266/553] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:58.216656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed119-e09d-466f-b4f3-f19a36992cff None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.291170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 288/554] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:58.292035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d7d8a-45a1-4ee9-a357-0490414f5d63 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.323267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed119-e09d-466f-b4f3-f19a36992cff None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:58.359549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3170d4-dc5d-474e-b984-205354145d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:58.360602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3170d4-dc5d-474e-b984-205354145d88 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.361109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3170d4-dc5d-474e-b984-205354145d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.361612 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3170d4-dc5d-474e-b984-205354145d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.416518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d7d8a-45a1-4ee9-a357-0490414f5d63 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:58.447601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3170d4-dc5d-474e-b984-205354145d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:58.449274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3170d4-dc5d-474e-b984-205354145d88 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:58.456171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:58.457211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.457692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.458165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.459164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:58.459723 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:58.461341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:58.475284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 289/555] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:58.476459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.552227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 267/556] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:31:58.553013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3170d4-dc5d-474e-b984-205354145d88 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.577317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08555dd4-84d3-42f9-8bd3-84c1f0f69050 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:58.611426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c106c6-e214-4eb9-bbd8-d598dfa4f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:58.612577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c106c6-e214-4eb9-bbd8-d598dfa4f508 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.613083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c106c6-e214-4eb9-bbd8-d598dfa4f508 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.613551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c106c6-e214-4eb9-bbd8-d598dfa4f508 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.624443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c106c6-e214-4eb9-bbd8-d598dfa4f508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-b7c106c6-e214-4eb9-bbd8-d598dfa4f508 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:58.632541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:58.633445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:58.634226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:58.636468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 290/557] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:58.637400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c106c6-e214-4eb9-bbd8-d598dfa4f508 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.652244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3170d4-dc5d-474e-b984-205354145d88 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:58.686880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1822e-208a-4cb8-a39e-bb5ddc8497fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:58.687699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1822e-208a-4cb8-a39e-bb5ddc8497fe None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.687978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1822e-208a-4cb8-a39e-bb5ddc8497fe None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.688246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1822e-208a-4cb8-a39e-bb5ddc8497fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.697882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1822e-208a-4cb8-a39e-bb5ddc8497fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:58.699359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1822e-208a-4cb8-a39e-bb5ddc8497fe None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-abc1822e-208a-4cb8-a39e-bb5ddc8497fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:58.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:58.718207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:58.719167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:58.719167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:58.719167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:58.719167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:58.719167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 268/558] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:58.719842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74c24-b7a6-44df-808a-39c2c56d6d69 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.720025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74c24-b7a6-44df-808a-39c2c56d6d69 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.720298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74c24-b7a6-44df-808a-39c2c56d6d69 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.721695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 269/559] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:58.722247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74c24-b7a6-44df-808a-39c2c56d6d69 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.747593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c106c6-e214-4eb9-bbd8-d598dfa4f508 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:58.784821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac56a08-22b3-419d-acdb-08e8a7cc505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:58.785615 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56a08-22b3-419d-acdb-08e8a7cc505a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.785897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56a08-22b3-419d-acdb-08e8a7cc505a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.786167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56a08-22b3-419d-acdb-08e8a7cc505a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.797093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac56a08-22b3-419d-acdb-08e8a7cc505a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:58.798564 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac56a08-22b3-419d-acdb-08e8a7cc505a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-fac56a08-22b3-419d-acdb-08e8a7cc505a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:58.816188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:58.817204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:58.818049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:58.818049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:58.818049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:58.818049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:58.818049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 291/560] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:58.818550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef946d0-42c3-45d1-849f-8e5f8e998f80 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.818841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef946d0-42c3-45d1-849f-8e5f8e998f80 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.819141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef946d0-42c3-45d1-849f-8e5f8e998f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.831432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74c24-b7a6-44df-808a-39c2c56d6d69 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:58.835974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8ef946d0-42c3-45d1-849f-8e5f8e998f80 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:58.837151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8ef946d0-42c3-45d1-849f-8e5f8e998f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:58.864965 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:58.865628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:58.865904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:58.866397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:58.866906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:58.867234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:58.868578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:58.880375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 270/561] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:58.885391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.906333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 292/562] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:58.906982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef946d0-42c3-45d1-849f-8e5f8e998f80 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:58.995049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580b8d7-451b-4b88-a1ea-cb62b6c407c6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.013912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef946d0-42c3-45d1-849f-8e5f8e998f80 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.026637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15995-b216-4434-824a-92bc68074646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.027321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15995-b216-4434-824a-92bc68074646 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.027603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15995-b216-4434-824a-92bc68074646 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.027903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15995-b216-4434-824a-92bc68074646 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.028625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b15995-b216-4434-824a-92bc68074646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:59.028928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b15995-b216-4434-824a-92bc68074646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.030322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b15995-b216-4434-824a-92bc68074646 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.046619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 271/563] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:59.046619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15995-b216-4434-824a-92bc68074646 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.051949 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.052611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.052890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.053167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.053885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:59.054182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.055575 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.071580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 293/564] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:59.071580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.146629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15995-b216-4434-824a-92bc68074646 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.175671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4563e2-d580-4ef1-81bc-40164d79dd0d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.186917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.187843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.188019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.188331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.201371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.202823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.212087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca36ee-d19a-457a-8b5c-6e4f63956b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.212882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca36ee-d19a-457a-8b5c-6e4f63956b82 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.213160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca36ee-d19a-457a-8b5c-6e4f63956b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.213431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca36ee-d19a-457a-8b5c-6e4f63956b82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:59.222586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:59.223814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:59.224886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:59.224886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:59.224886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:59.224886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:59.225142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca36ee-d19a-457a-8b5c-6e4f63956b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:31:59.226568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 272/565] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:59.227571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-adca36ee-d19a-457a-8b5c-6e4f63956b82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:31:59.232358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:59.233420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 294/566] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:59.234336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca36ee-d19a-457a-8b5c-6e4f63956b82 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.331748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca36ee-d19a-457a-8b5c-6e4f63956b82 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.332365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174753d-b27f-43d2-aa68-66612bd5d550 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.362725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.363084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.363545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.363825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.363916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.364098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.364188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.364378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.370492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.371025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.372477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.372976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:31:59.386264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:59.387257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:59.388270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:31:59.388270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:31:59.388270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:31:59.388270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:31:59.388270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:31:59.388270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:31:59.388270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:31:59.388270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:31:59.389305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:59.390831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:31:59.391788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:59.392306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 295/567] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:59.392386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 273/568] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:59.392917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.393036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.481725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cdc3c-3808-4dd1-900a-8d4d6cfb2071 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.484018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ad4eb-40c5-47dd-9962-66e81cd7946a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.513486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.514137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.514419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.514693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.515440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:59.515748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.516195 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975352f-94a1-4359-a05f-0ea4e8844225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.516847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975352f-94a1-4359-a05f-0ea4e8844225 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.517101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.517193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975352f-94a1-4359-a05f-0ea4e8844225 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.517385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975352f-94a1-4359-a05f-0ea4e8844225 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.518130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975352f-94a1-4359-a05f-0ea4e8844225 None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:59.518434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975352f-94a1-4359-a05f-0ea4e8844225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.519804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975352f-94a1-4359-a05f-0ea4e8844225 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.527398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 274/569] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:59.532220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 296/570] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:59.532377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfc104-7ade-4460-8e93-d28dbaa9bcf3 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.532459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.532531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfc104-7ade-4460-8e93-d28dbaa9bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.532531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfc104-7ade-4460-8e93-d28dbaa9bcf3 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.532531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 275/571] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:31:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:31:59.532531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfc104-7ade-4460-8e93-d28dbaa9bcf3 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.625405 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764077-ec25-4495-b4ad-e92a967158d4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.626922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfc104-7ade-4460-8e93-d28dbaa9bcf3 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.656678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.657421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.657697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.657817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.657970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.658350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.658633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.658780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:59.658910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.659131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.659769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:59.660077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.660558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.661482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.673362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 297/572] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:59.674143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.682055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 276/573] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:59.682055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.766217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f904c-068b-4cd1-a8db-8c89f69f28b3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.771739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee1d5-44c2-4930-bddd-194cdb447760 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.798011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.798794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.799106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.799385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.803466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8eb32-2299-44f9-b41f-fa4abb5bbe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.804241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8eb32-2299-44f9-b41f-fa4abb5bbe5c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.804524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8eb32-2299-44f9-b41f-fa4abb5bbe5c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.804796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8eb32-2299-44f9-b41f-fa4abb5bbe5c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.808940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.810995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.812198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8eb32-2299-44f9-b41f-fa4abb5bbe5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.813620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8eb32-2299-44f9-b41f-fa4abb5bbe5c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d2c8eb32-2299-44f9-b41f-fa4abb5bbe5c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:31:59.827930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:59.828833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 16:31:59.829790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:31:59.830320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:31:59.831727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:31:59.832969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:31:59.832969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:31:59.832969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:31:59.832969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:31:59.833242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 277/574] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:59.833242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc0ad-6cef-49d0-8fc1-f90cf38966b8 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.833242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc0ad-6cef-49d0-8fc1-f90cf38966b8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.833242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dc0ad-6cef-49d0-8fc1-f90cf38966b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.834201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 298/575] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:31:59.834631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.848346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-614dc0ad-6cef-49d0-8fc1-f90cf38966b8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:31:59.849531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-614dc0ad-6cef-49d0-8fc1-f90cf38966b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:31:59.912908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 278/576] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:31:59.913943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dc0ad-6cef-49d0-8fc1-f90cf38966b8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:31:59.938730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6d191-a48b-4dd7-b052-f5f4a2ec65ee None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:31:59.970294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:31:59.970935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:31:59.971237 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:31:59.971507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:31:59.972320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=5551a6e71bb0499d9161e6213acc0af9) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:31:59.972625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:31:59.974029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:31:59.979263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 299/577] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/role_assignments?user.id=5551a6e71bb0499d9161e6213acc0af9&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:31:59.980021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.013146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dc0ad-6cef-49d0-8fc1-f90cf38966b8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.049509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.050333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.050619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.050897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.062280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.063803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:00.082398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:00.083552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:00.084469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:00.084469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:00.084469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:00.084469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:00.084469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 279/578] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:00.085072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.092411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a852f97-b44a-425f-a465-df8859efd2af None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.127070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.127757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.128042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.128321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.129190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:00.129504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.131000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.154499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 300/579] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 16:31:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:00.154499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.188718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a23ab-c060-44fc-b519-c50cb5b16630 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.221949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.222736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.223283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.223769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.224755 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:00.225065 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.226632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.245817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 280/580] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:00.245817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.256669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d06b01-f5f9-46da-a456-751dc351eef4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.292855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e747f-f089-4aec-966e-e7dd414ac91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.293707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e747f-f089-4aec-966e-e7dd414ac91e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.294019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e747f-f089-4aec-966e-e7dd414ac91e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.294286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e747f-f089-4aec-966e-e7dd414ac91e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.304595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e747f-f089-4aec-966e-e7dd414ac91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-2b0e747f-f089-4aec-966e-e7dd414ac91e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:00.312357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:00.313472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 301/581] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:00.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e747f-f089-4aec-966e-e7dd414ac91e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.349333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c842422-31d0-49ef-bd4e-f4ce58b13f0d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.381372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.382113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.382294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.382569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.383311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:00.383639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.384988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.396929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 281/582] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:00.397843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.416657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e747f-f089-4aec-966e-e7dd414ac91e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.449617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.451004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.451279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.451547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.461919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.463392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:00.480711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:00.481697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:00.482607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:00.482607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:00.482607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:00.482607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:00.484194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 302/583] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:00.485025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.501302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcebd6f-8d4a-4201-8ab2-1daf4c72f8e5 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.536778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.537580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.537866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.538143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.545425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.546868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:00.561318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:00.562365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:32:00.563727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:00.567154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 282/584] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:00.567786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.587258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71a65-4a16-46bf-80dd-2798f0bf572d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.628011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.628847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.629194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.629471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.630238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:00.630537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.632004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.645086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 303/585] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:00.645086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.669013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5b55-0036-4e4a-96b2-4e66cf295785 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.707561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.708389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.708671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.708947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.715861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.717321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:00.731262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:00.732362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:00.733430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 283/586] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:00.733929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.747479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620f0db-224d-4b0d-bb30-98faff4af7ad None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.780582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.781244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.781520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.781789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.782500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:00.782800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.784216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.795951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 304/587] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:00.800754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.831595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55c817-c526-48ee-b040-976435c2556f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.864009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.864724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.865060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.865340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.866177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:00.866488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.868007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.890993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 284/588] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:00.892070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.907725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea56cef-e512-4945-914e-db7c2de3cc4d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:00.944435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:00.945235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:00.945587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:00.945930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:00.956243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:00.957741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:00.975055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:00.976128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:00.977219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:00.977219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:00.977219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:00.977219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:00.980687 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 305/589] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:00.982083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:00.991951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941594bf-07ab-4f77-b0fd-5dddf5e97a7e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.024184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.024840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.025142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.025398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.026183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:01.026492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.027938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.043571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 285/590] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:01.043571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.086008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a590c-7170-4f6e-a8f9-55a752bd1fb7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.120547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.121518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.122477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.122845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.129389 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.130903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.140970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7439c-a1da-4e5e-b43a-2077cd536919 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:01.144506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:01.145553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:01.146669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:01.146669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:01.146669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:01.146669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:01.146669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:01.146669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:01.146669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:01.146669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:01.152778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 306/591] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:01.152778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.177138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.177951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.178229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.178506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.189585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.191069 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:01.210153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:01.211338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:01.212236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:01.212236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:01.212236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:01.212236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:01.215423 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 286/592] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:01.217251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.267273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7051545-7001-4cb0-b1de-6d4c4651a61e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.303823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.304488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.304772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.305048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.305773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:01.306082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.307482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.317710 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0114e23-4de9-4614-a4a2-277d2841b98f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.319328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 307/593] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:01.320774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.351198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60c6b1-036f-4291-b810-3c829d4158f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.352316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60c6b1-036f-4291-b810-3c829d4158f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.352763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60c6b1-036f-4291-b810-3c829d4158f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.353038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60c6b1-036f-4291-b810-3c829d4158f9 None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/3d11d338bf2c4521bdfddc5d5c8da899/roles/03a8445ffd574dc38f0948d45ce527b7` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.367727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60c6b1-036f-4291-b810-3c829d4158f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=3d11d338bf2c4521bdfddc5d5c8da899, role_id=03a8445ffd574dc38f0948d45ce527b7)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.369472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60c6b1-036f-4291-b810-3c829d4158f9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.382320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 287/594] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:01 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/3d11d338bf2c4521bdfddc5d5c8da899/roles/03a8445ffd574dc38f0948d45ce527b7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:32:01.383402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60c6b1-036f-4291-b810-3c829d4158f9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.428885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837206b5-5bd9-45ed-a0e8-e428312c678d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.466434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.467388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.467852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.468275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.469474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:01.470145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.472253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.486839 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 308/595] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:01.488233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.500774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60c6b1-036f-4291-b810-3c829d4158f9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.538889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.540607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.540889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.541164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.541914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:01.542224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.544691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.557337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 288/596] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:01.558245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.603390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e071-5ad8-4060-91aa-f4888e2fb48e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.638946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.639846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.640134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.640449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.648445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.649894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:01.666731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:01.667770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:32:01.668788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:01.673510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 309/597] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:01.674501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.682421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8172d-5c03-4f40-a678-73263975ec8e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.727090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46d3b4-6c6c-4ecf-bae3-ab1a691f8c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.728921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d3b4-6c6c-4ecf-bae3-ab1a691f8c50 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.729500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d3b4-6c6c-4ecf-bae3-ab1a691f8c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.729960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d3b4-6c6c-4ecf-bae3-ab1a691f8c50 None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/039df81163264994a86fe2e98bb96983/roles/03a8445ffd574dc38f0948d45ce527b7` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.750537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d3b4-6c6c-4ecf-bae3-ab1a691f8c50 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=039df81163264994a86fe2e98bb96983, role_id=03a8445ffd574dc38f0948d45ce527b7)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.752744 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d3b4-6c6c-4ecf-bae3-ab1a691f8c50 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.768750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 289/598] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:01 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/039df81163264994a86fe2e98bb96983/roles/03a8445ffd574dc38f0948d45ce527b7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:32:01.770359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46d3b4-6c6c-4ecf-bae3-ab1a691f8c50 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.779928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba7a30-1b1c-4ca1-9f24-3902523ccc14 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.821766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.823052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.823542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.823998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.833995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.836181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:01.857078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:01.858050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:01.858948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:01.858948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:01.858948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:01.858948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:01.858948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:01.858948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:01.858948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:01.858948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:01.861900 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 310/599] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:01.870451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:01.899841 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46d3b4-6c6c-4ecf-bae3-ab1a691f8c50 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:01.939714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:01.940658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:01.941041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:01.941475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:01.947315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:01.947315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:01.947315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:01.968952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 290/600] 10.222.0.57 () {56 vars in 1139 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:01.970220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:02.072215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da588-98f6-42b3-a9fb-c8c27bb49034 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:02.119738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32282315-dc40-4b8d-b0a4-cc998fe1f2ab None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:02.126822 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:02.127642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.128024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.128399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.129534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:02.129656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:02.131256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:02.144011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 311/601] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:02.151045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:02.159744 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:02.160596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.160869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.161144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.173428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:02.175205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:02.193003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:02.193963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:02.194953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:02.194953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:02.194953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:02.194953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:02.194953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 291/602] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:02.201179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:02.281694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ca56e-1cc3-4df5-b555-ce6d7c9df404 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:02.306602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510a3b7-7660-4832-8e17-83a8c0ce4476 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:02.316672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6dc2-b075-4d56-8010-4f9ddb7820b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:02.317985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6dc2-b075-4d56-8010-4f9ddb7820b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.318482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6dc2-b075-4d56-8010-4f9ddb7820b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.319016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6dc2-b075-4d56-8010-4f9ddb7820b9 None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/c789864ed513471fb6b367aecf236828/roles/03a8445ffd574dc38f0948d45ce527b7` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.334410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc6dc2-b075-4d56-8010-4f9ddb7820b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=c789864ed513471fb6b367aecf236828, role_id=03a8445ffd574dc38f0948d45ce527b7)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:02.336190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc6dc2-b075-4d56-8010-4f9ddb7820b9 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:02.349175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f98198-ad15-4bfa-a04f-208238b409c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:02.349616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98198-ad15-4bfa-a04f-208238b409c1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.349893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98198-ad15-4bfa-a04f-208238b409c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.350163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98198-ad15-4bfa-a04f-208238b409c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.350912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98198-ad15-4bfa-a04f-208238b409c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:02.351247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98198-ad15-4bfa-a04f-208238b409c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:02.352612 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98198-ad15-4bfa-a04f-208238b409c1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:02.355681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 312/603] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:02 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/c789864ed513471fb6b367aecf236828/roles/03a8445ffd574dc38f0948d45ce527b7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:32:02.361279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c43cb-4700-4edd-96f9-37b39745a7b2 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.361279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c43cb-4700-4edd-96f9-37b39745a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.361279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c43cb-4700-4edd-96f9-37b39745a7b2 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.361592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 313/604] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:02.370029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 292/605] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:02.376084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c43cb-4700-4edd-96f9-37b39745a7b2 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:02.380666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94d0fa-a864-4794-9370-d2aff225ce61 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.380960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94d0fa-a864-4794-9370-d2aff225ce61 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.381255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94d0fa-a864-4794-9370-d2aff225ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.412271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-8a94d0fa-a864-4794-9370-d2aff225ce61 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:02.413492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8a94d0fa-a864-4794-9370-d2aff225ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:02.491518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c43cb-4700-4edd-96f9-37b39745a7b2 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:02.532229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:02.533039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.533323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.533601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.542422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:02.543959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:02.559181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:02.560185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:02.561084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:02.561084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:02.561084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:02.561084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:02.561084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:02.561084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:02.561084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:02.561084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:02.564401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 314/606] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:02.567841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:02.578077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 293/607] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:02.603338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94d0fa-a864-4794-9370-d2aff225ce61 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:02.685041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0029-b6be-4d56-8d1a-44b2c145d728 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:02.716253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94d0fa-a864-4794-9370-d2aff225ce61 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:02.734810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:02.735897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.736601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.738722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.739888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:02.740436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:02.743125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:02.758735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 315/608] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:02.764885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:02.783642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09cf64-31d4-4ce8-b580-ce241e902092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:02.785976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cf64-31d4-4ce8-b580-ce241e902092 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:02.786470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cf64-31d4-4ce8-b580-ce241e902092 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:02.786949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cf64-31d4-4ce8-b580-ce241e902092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:02.807916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09cf64-31d4-4ce8-b580-ce241e902092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-3c09cf64-31d4-4ce8-b580-ce241e902092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:02.823160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:02.824258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:02.826473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:02.831389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 294/609] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:02.840297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09cf64-31d4-4ce8-b580-ce241e902092 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:02.970162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c03-6999-489f-9921-70cf59b1a39b None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:03.024483 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09cf64-31d4-4ce8-b580-ce241e902092 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:03.030262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eef04-b3b7-4afa-85eb-1e1d5fa0a6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:03.031207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef04-b3b7-4afa-85eb-1e1d5fa0a6be None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:03.031492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef04-b3b7-4afa-85eb-1e1d5fa0a6be None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:03.031768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef04-b3b7-4afa-85eb-1e1d5fa0a6be None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/05b1227b7f36498e8c1f1e27fa0ccb46/roles/03a8445ffd574dc38f0948d45ce527b7` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:03.057573 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eef04-b3b7-4afa-85eb-1e1d5fa0a6be None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=05b1227b7f36498e8c1f1e27fa0ccb46, role_id=03a8445ffd574dc38f0948d45ce527b7)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:03.059040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eef04-b3b7-4afa-85eb-1e1d5fa0a6be None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:03.087351 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 316/610] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:02 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/05b1227b7f36498e8c1f1e27fa0ccb46/roles/03a8445ffd574dc38f0948d45ce527b7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:32:03.091851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:03.092579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:03.092864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:03.093132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:03.093978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:03.094288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:03.095746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:03.111800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 295/611] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:03.113166 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eef04-b3b7-4afa-85eb-1e1d5fa0a6be None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:03.253986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eef04-b3b7-4afa-85eb-1e1d5fa0a6be None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:03.289506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:03.290313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:03.290597 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:03.290861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:03.302738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:03.304235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:03.322920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:03.323929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:03.324865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:03.324865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:03.324865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:03.324865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:03.329454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 317/612] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:03.330789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:03.436186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f4bb-64b5-4aeb-931c-5b53b6acb457 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:03.472828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:03.473491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:03.473775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:03.474178 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:03.474917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:03.475257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:03.476632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:03.489869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 296/613] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:03.494439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:03.601943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad88fa-16c9-407f-b034-bfdbd78f8ce5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:03.636461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:03.637297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:03.638148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:03.638422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:03.646779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:03.648267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:03.663509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:03.665791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:03.668140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:03.669827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 318/614] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:03.675028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:03.771740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9fb0-9705-4c48-b798-f718e75df8a0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:03.805540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:03.806218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:03.806495 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:03.806771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:03.807655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:03.807963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:03.809936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:03.831072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 297/615] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 16:32:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:03.833322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:03.937418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89e9e6-989d-4558-a851-7a9f4d398326 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:03.973282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757eed8-7518-439a-80e6-c6663e099427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:03.974106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757eed8-7518-439a-80e6-c6663e099427 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:03.974387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757eed8-7518-439a-80e6-c6663e099427 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:03.974662 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757eed8-7518-439a-80e6-c6663e099427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:03.986531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757eed8-7518-439a-80e6-c6663e099427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:03.988021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757eed8-7518-439a-80e6-c6663e099427 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-7757eed8-7518-439a-80e6-c6663e099427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:04.007108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:04.009726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:04.012313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:04.012313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:04.012313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:04.012313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:04.016099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 319/616] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:04.016459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:04.154142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443d227-8c14-42cc-8bdd-0ed31985e889 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:04.184297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0a9a-6053-421d-b5d7-fff789859da1 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.185145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0a9a-6053-421d-b5d7-fff789859da1 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.185368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b0a9a-6053-421d-b5d7-fff789859da1 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.186746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 320/617] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:04.193997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a12f0-821c-4828-b513-169a52a78d4a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.194546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a12f0-821c-4828-b513-169a52a78d4a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.195208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a12f0-821c-4828-b513-169a52a78d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.213247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:04.213933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.214216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.214491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.215255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:04.215598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:04.216982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:04.230057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-6e2a12f0-821c-4828-b513-169a52a78d4a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:04.233697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6e2a12f0-821c-4828-b513-169a52a78d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:04.249875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 298/618] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:04.250720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:04.381839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3777fb6-49ac-4472-a680-0a49ec1ee1c3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:04.418297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:04.419921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.420129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.420391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.422025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 321/619] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:04.432855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:04.434360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:04.460767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:04.461766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:04.462661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 299/620] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:04.470028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a12f0-821c-4828-b513-169a52a78d4a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:04.479442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:04.590344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4539-ca14-4c67-a817-89c27ee60861 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:04.628090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc30c44-364f-4e06-bd34-eb49d97f5d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:04.629042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc30c44-364f-4e06-bd34-eb49d97f5d9a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.629330 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc30c44-364f-4e06-bd34-eb49d97f5d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.629608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc30c44-364f-4e06-bd34-eb49d97f5d9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.640838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc30c44-364f-4e06-bd34-eb49d97f5d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-6cc30c44-364f-4e06-bd34-eb49d97f5d9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:04.649901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:04.650849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:04.651746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:04.658985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 300/621] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:04.658985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc30c44-364f-4e06-bd34-eb49d97f5d9a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:04.701929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a12f0-821c-4828-b513-169a52a78d4a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:04.747281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed39241-e446-4f77-bd46-51adab612fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:04.747946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39241-e446-4f77-bd46-51adab612fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.748222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39241-e446-4f77-bd46-51adab612fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.748490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39241-e446-4f77-bd46-51adab612fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.749277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed39241-e446-4f77-bd46-51adab612fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:04.749575 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed39241-e446-4f77-bd46-51adab612fb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:04.750999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed39241-e446-4f77-bd46-51adab612fb6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:04.764506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 322/622] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:04.765913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceecc3f-24c2-4b88-963a-040f84665467 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.766200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceecc3f-24c2-4b88-963a-040f84665467 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.766473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceecc3f-24c2-4b88-963a-040f84665467 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.771897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 323/623] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:04.773008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170088-163e-4697-9cbe-2461c9314752 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.773297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170088-163e-4697-9cbe-2461c9314752 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.773568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170088-163e-4697-9cbe-2461c9314752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.786122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc30c44-364f-4e06-bd34-eb49d97f5d9a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:04.790226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7c170088-163e-4697-9cbe-2461c9314752 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:04.791441 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7c170088-163e-4697-9cbe-2461c9314752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:04.829624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:04.831222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.831502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.831770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:04.832524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:04.832823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:04.834186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:04.845458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 301/624] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:04.846243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:04.865722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 324/625] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:32:04.866563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170088-163e-4697-9cbe-2461c9314752 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:04.953023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08077bfa-fa24-4674-abd5-870ae275525f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:04.985844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170088-163e-4697-9cbe-2461c9314752 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:04.988060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44d61-3b22-4127-b55b-6742e718be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:04.988938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44d61-3b22-4127-b55b-6742e718be54 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:04.989214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44d61-3b22-4127-b55b-6742e718be54 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:04.989485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44d61-3b22-4127-b55b-6742e718be54 None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/5551a6e71bb0499d9161e6213acc0af9/roles/03a8445ffd574dc38f0948d45ce527b7` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.003161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44d61-3b22-4127-b55b-6742e718be54 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=5551a6e71bb0499d9161e6213acc0af9, role_id=03a8445ffd574dc38f0948d45ce527b7)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.004596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44d61-3b22-4127-b55b-6742e718be54 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:05.018940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 302/626] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:04 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/5551a6e71bb0499d9161e6213acc0af9/roles/03a8445ffd574dc38f0948d45ce527b7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:32:05.020509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676439e-626e-4c1e-b586-e8e9d3fcbe82 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.020993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676439e-626e-4c1e-b586-e8e9d3fcbe82 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.021480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676439e-626e-4c1e-b586-e8e9d3fcbe82 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.022990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 303/627] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:05.028920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676439e-626e-4c1e-b586-e8e9d3fcbe82 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.029515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9103c4-e03c-44c4-bd35-4cf4811042c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.030497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9103c4-e03c-44c4-bd35-4cf4811042c6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.030844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9103c4-e03c-44c4-bd35-4cf4811042c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.031169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9103c4-e03c-44c4-bd35-4cf4811042c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.046110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9103c4-e03c-44c4-bd35-4cf4811042c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.048865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9103c4-e03c-44c4-bd35-4cf4811042c6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-fd9103c4-e03c-44c4-bd35-4cf4811042c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:05.074187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:05.075813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:05.076744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:05.076744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:05.076744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:05.076744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:05.080777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 325/628] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:05.082985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1101a2-9521-451d-b9fd-0799e822de8b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.083279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1101a2-9521-451d-b9fd-0799e822de8b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.083578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1101a2-9521-451d-b9fd-0799e822de8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.107514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1d1101a2-9521-451d-b9fd-0799e822de8b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:05.108912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1d1101a2-9521-451d-b9fd-0799e822de8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:05.163217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676439e-626e-4c1e-b586-e8e9d3fcbe82 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.207066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 326/629] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:05.207066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1101a2-9521-451d-b9fd-0799e822de8b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.216685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e63df-bf8a-466f-8d33-57299be30098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.217851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e63df-bf8a-466f-8d33-57299be30098 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.218357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e63df-bf8a-466f-8d33-57299be30098 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.218834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e63df-bf8a-466f-8d33-57299be30098 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.232213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e63df-bf8a-466f-8d33-57299be30098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-dc6e63df-bf8a-466f-8d33-57299be30098 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:05.242639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:05.243679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:05.244512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:05.248486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 304/630] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:05.248486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e63df-bf8a-466f-8d33-57299be30098 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.323188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1101a2-9521-451d-b9fd-0799e822de8b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.352028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e63df-bf8a-466f-8d33-57299be30098 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.367127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.368241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.368589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.369071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.369951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:05.370321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.372343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:05.386220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 327/631] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:05.387924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.402724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed40c-b127-4369-a76d-2247a66012b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.404897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed40c-b127-4369-a76d-2247a66012b3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.405478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed40c-b127-4369-a76d-2247a66012b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.405938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed40c-b127-4369-a76d-2247a66012b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.419800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ed40c-b127-4369-a76d-2247a66012b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-137ed40c-b127-4369-a76d-2247a66012b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:05.430771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:05.432095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:05.433131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:05.440622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 305/632] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:05.440622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed40c-b127-4369-a76d-2247a66012b3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.514881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d5851-803e-41b2-abf6-8962cfcef03e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.548477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ed40c-b127-4369-a76d-2247a66012b3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.551510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.552443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.552989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.553463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.554430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:05.554935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.556576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:05.569826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 328/633] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:05.571228 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.591277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.592714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.593414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.594217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.603872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.605656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:05.620695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:05.621829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:05.622781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:05.625393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 306/634] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:05.626438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.679408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20051af2-b234-4601-8e7d-e1def8dc11fd None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.712543 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.713289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.713477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.713746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.714484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:05.714786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.717315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:05.732095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 329/635] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:05.732095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.735953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5359e7-5773-4b48-8ab5-f9650a5708e5 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.774482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.776048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.776748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.777234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.794789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.797360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:05.820642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:05.821623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:05.822505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:05.822505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:05.822505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:05.822505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:05.829114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 307/636] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:05.829114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.846349 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626e9d0-768e-44dd-a6be-8003802bd9b4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.897692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.898841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.899377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.900344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.901702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:05.902232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.905486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:05.928791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 330/637] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:05.930029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:05.940624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aef3e-3802-41f5-893b-f0dd545c6b1f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:05.974445 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:05.975297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:05.975580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:05.975856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:05.986899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:05.988566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:06.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:06.007204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:06.008312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:06.008312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:06.008312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:06.008312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:06.009804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 308/638] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:06.010755 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.037071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926037b-6782-410c-bc97-7881efd1c438 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.069880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b5503-3c82-42dc-8188-3414ec88a983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.075993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b5503-3c82-42dc-8188-3414ec88a983 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.075993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b5503-3c82-42dc-8188-3414ec88a983 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.075993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b5503-3c82-42dc-8188-3414ec88a983 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.075993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b5503-3c82-42dc-8188-3414ec88a983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:06.075993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b5503-3c82-42dc-8188-3414ec88a983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.076614 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b5503-3c82-42dc-8188-3414ec88a983 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.087639 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 331/639] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:06.088945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8e64-bf3e-406a-977c-520070d6a979 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.089235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8e64-bf3e-406a-977c-520070d6a979 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.089516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b8e64-bf3e-406a-977c-520070d6a979 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.091459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 332/640] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:06.095496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b8e64-bf3e-406a-977c-520070d6a979 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.115630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7163f-bfa7-4a8c-85de-1db828d105b4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.154673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aafe91-4961-431c-bf47-46ffb9611381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.155353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aafe91-4961-431c-bf47-46ffb9611381 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.155636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aafe91-4961-431c-bf47-46ffb9611381 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.155912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aafe91-4961-431c-bf47-46ffb9611381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.197598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b8e64-bf3e-406a-977c-520070d6a979 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.224240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aafe91-4961-431c-bf47-46ffb9611381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.225827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aafe91-4961-431c-bf47-46ffb9611381 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.230402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.231817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.232261 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.232691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.233567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:06.234037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.235403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.247623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 333/641] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:06.248439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.333104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 309/642] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:32:06.333104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68da5c-76c7-424d-8b0d-af4bd59ddd9d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.333104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68da5c-76c7-424d-8b0d-af4bd59ddd9d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.333104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68da5c-76c7-424d-8b0d-af4bd59ddd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.348282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3921c9-6d5a-4e26-8657-c11c187cec4f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.349027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ec68da5c-76c7-424d-8b0d-af4bd59ddd9d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:06.350407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ec68da5c-76c7-424d-8b0d-af4bd59ddd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:06.390634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.391457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.391746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.392013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.399095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.400525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.421687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 310/643] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:06.421687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68da5c-76c7-424d-8b0d-af4bd59ddd9d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:06.421962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:06.423215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 334/644] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:06.424400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.528808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68da5c-76c7-424d-8b0d-af4bd59ddd9d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.532951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b78f-04b2-4493-8aaa-b9dac74f7f7f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.560901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.561703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.561986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.562260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.567856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.568645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.568922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.569190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.569533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.571215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.579364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.580769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:06.586383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:06.587575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 311/645] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:06.593891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:06.599260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:06.600978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:06.602090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:06.602090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:06.602090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:06.602090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:06.604959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 335/646] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:06.606136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.706498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1728f1-d8b5-4ad5-8224-96eb5ddc4e4b None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.718703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21510777-10b3-45f6-aa42-d35216efb530 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.743402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.744075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.744352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.744618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.745509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:06.745751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.747721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.754792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4492672-9db7-413d-adb9-2d3be375b7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.755611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492672-9db7-413d-adb9-2d3be375b7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.755891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492672-9db7-413d-adb9-2d3be375b7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.756164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4492672-9db7-413d-adb9-2d3be375b7d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.765400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 312/647] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:06.766233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.767776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4492672-9db7-413d-adb9-2d3be375b7d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-f4492672-9db7-413d-adb9-2d3be375b7d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:06.778064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:06.779355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:06.780304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 336/648] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:06.781013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4492672-9db7-413d-adb9-2d3be375b7d1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.866493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a2144-8bf0-4401-b6f6-ee84847f3980 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.894831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4492672-9db7-413d-adb9-2d3be375b7d1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:06.935258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.935943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.936246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.936750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.937604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:06.937908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.940024 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.959093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:06.959093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:06.959093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:06.959093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:06.959545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:06.959545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:06.959690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 313/649] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:06.960505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:06.964367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:06.978856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 337/650] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:06.978856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.091673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84319a13-1307-4449-a21a-a584adc51e54 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:07.109415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed83314-4dad-4ba2-878b-6272e402975f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:07.133986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42832-9046-414b-aaca-5270d9e6a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:07.134568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42832-9046-414b-aaca-5270d9e6a094 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.134850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42832-9046-414b-aaca-5270d9e6a094 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.135219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42832-9046-414b-aaca-5270d9e6a094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.151459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:07.152523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.152806 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.153664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.154599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:07.154903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:07.156502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:07.166927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 338/651] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:07.167826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.221952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c42832-9046-414b-aaca-5270d9e6a094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:07.223825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c42832-9046-414b-aaca-5270d9e6a094 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:07.293366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c94946-6a27-4784-90b5-40dd4cb42ed3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:07.327381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd101b-ab10-4274-89be-cf6fe84d0769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:07.328276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd101b-ab10-4274-89be-cf6fe84d0769 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.328710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd101b-ab10-4274-89be-cf6fe84d0769 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.329132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd101b-ab10-4274-89be-cf6fe84d0769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.338662 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 314/652] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:32:07.339546 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42832-9046-414b-aaca-5270d9e6a094 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.396331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd101b-ab10-4274-89be-cf6fe84d0769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:07.397792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd101b-ab10-4274-89be-cf6fe84d0769 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:07.452424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42832-9046-414b-aaca-5270d9e6a094 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:07.488070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b357c-239c-49ed-8600-d7f92de6192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:07.488873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b357c-239c-49ed-8600-d7f92de6192f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.489154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b357c-239c-49ed-8600-d7f92de6192f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.489428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b357c-239c-49ed-8600-d7f92de6192f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.499017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 339/653] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:32:07.499017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd101b-ab10-4274-89be-cf6fe84d0769 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.500407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b357c-239c-49ed-8600-d7f92de6192f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:07.502242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b357c-239c-49ed-8600-d7f92de6192f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-cb0b357c-239c-49ed-8600-d7f92de6192f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:07.517440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:07.518381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:07.519358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 315/654] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:07.520823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695defc-61ef-4508-8384-e6785d8b38a1 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.521106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695defc-61ef-4508-8384-e6785d8b38a1 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.521643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695defc-61ef-4508-8384-e6785d8b38a1 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.522775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 316/655] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:07.527361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695defc-61ef-4508-8384-e6785d8b38a1 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.593890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd101b-ab10-4274-89be-cf6fe84d0769 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:07.628573 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:07.629402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.629670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.630025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.630458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695defc-61ef-4508-8384-e6785d8b38a1 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:07.641433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:07.643188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:07.660559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:07.661630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:07.662560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:07.662560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:07.662560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:07.662560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:07.662560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 340/656] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:07.662846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.670914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:07.671813 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.672160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.672499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.685486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:07.688142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:07.705487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:07.706388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:07.707354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:07.707354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:07.707354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:07.707354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:07.711295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 317/657] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:07.712331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.763352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9fb7-3f96-46ca-936a-253af8a7727a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:07.797474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e923-3099-4806-8f49-29e9e466dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:07.798361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e923-3099-4806-8f49-29e9e466dce8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.798779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e923-3099-4806-8f49-29e9e466dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.799096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e923-3099-4806-8f49-29e9e466dce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.809256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99e923-3099-4806-8f49-29e9e466dce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:07.811430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99e923-3099-4806-8f49-29e9e466dce8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:07.813166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35df95-2c54-41e6-a3b8-f068b451bff8 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-7c99e923-3099-4806-8f49-29e9e466dce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:07.828636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:07.829773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:07.831041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:07.831041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:07.831041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:07.831041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:07.831041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 341/658] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:07.831041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a63c2-149b-4b01-a8e9-7191942b8e5b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.831410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a63c2-149b-4b01-a8e9-7191942b8e5b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.831602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a63c2-149b-4b01-a8e9-7191942b8e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.848208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:07.848863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:07.849146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:07.849494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:07.850232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b16a63c2-149b-4b01-a8e9-7191942b8e5b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:07.850339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:07.850590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:07.851430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b16a63c2-149b-4b01-a8e9-7191942b8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:07.852067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:07.865871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 318/659] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:07.867023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.921759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 342/660] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:07.922541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a63c2-149b-4b01-a8e9-7191942b8e5b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:07.970122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359e645-6d87-4938-b3c5-ddc69bc07e13 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.004527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.005194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.005478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.005748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.006471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:08.006776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.008184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.019903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 319/661] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:08.020756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.024946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a63c2-149b-4b01-a8e9-7191942b8e5b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.060572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.061242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.061530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.061807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.062570 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:08.062846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.064274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.078898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 343/662] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:08.078898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.129188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54bb51-1038-45ab-921e-d0b617a3e5af None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.163987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.164826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.165262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.165377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.166210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:08.166563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.168058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.175786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222da61-db40-4b63-ae7f-92cdde61e800 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.181002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 320/663] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:08.181827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.209604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.210255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.210749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.210868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.211647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=3d11d338bf2c4521bdfddc5d5c8da899) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:08.211957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.213383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.228320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 344/664] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/role_assignments?user.id=3d11d338bf2c4521bdfddc5d5c8da899&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:08.228320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.291711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60866b-32d2-4eeb-ade6-e557a623931a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.331491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc8168-30a6-44d5-8ee8-830fb5abbe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.332332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8168-30a6-44d5-8ee8-830fb5abbe19 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.332618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8168-30a6-44d5-8ee8-830fb5abbe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.332893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc8168-30a6-44d5-8ee8-830fb5abbe19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.343679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489888c-4985-41c6-9993-0da6c56f0c3d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.345719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc8168-30a6-44d5-8ee8-830fb5abbe19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-43bc8168-30a6-44d5-8ee8-830fb5abbe19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:08.353817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:08.354845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:08.355735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 321/665] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:08.357032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc8168-30a6-44d5-8ee8-830fb5abbe19 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.395984 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.396804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.397083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.397351 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.406647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.408138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:08.424224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:08.425290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:08.426260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 345/666] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:08.427361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.499225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc8168-30a6-44d5-8ee8-830fb5abbe19 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.543047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.543320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.543783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.543890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.553246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.554689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d40cb7-1feb-49e4-8f63-b5ce312c1004 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.554810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:08.569952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:08.570929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:08.572132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 322/667] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:08.572674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.594851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.595744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.598986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.598986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.607053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.608349 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:08.627786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:08.628734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:08.629624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:08.629624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:08.629624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:08.629624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:08.629624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:08.629624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:08.629624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:08.629624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:08.633626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 346/668] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:08.634494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.683542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc371e-eeaa-4b10-8b1f-4f9c08d96f91 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.719344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.720379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.720866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.721344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.722283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:08.722783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.724374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.737384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 323/669] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:08.738536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.739797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8058fb-5794-467d-8694-e080097f3950 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.775614 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.776267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.776717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.776894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.777720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:08.778699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.780263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.800701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 347/670] 10.222.0.57 () {56 vars in 1139 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:08.801768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.856229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf48af-5d81-436f-a281-95c69d0fa0dc None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.904150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.905562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.906763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.907220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.908392 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:08.908704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.910416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.925262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 324/671] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:08.927927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:08.930651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa789a78-f523-45d1-9f60-c2b0ede057b6 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:08.970666 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:08.971306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:08.971592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:08.971869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:08.972842 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:08.973154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:08.974783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:08.995296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 348/672] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:08.995296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:09.057277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62e451-0082-406c-88b3-7ef3646e1237 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:09.101549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:09.102414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:09.102694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:09.103017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:09.114902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:09.115289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcaac2-180a-4882-99aa-46968af8155f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:09.115404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:09.138085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:09.139090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:09.140009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:09.140009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:09.140009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:09.140009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:09.143218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 325/673] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:09.144822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:09.158924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14551e5a-2252-4b39-a3f8-1b96d1ea0cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:09.159631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14551e5a-2252-4b39-a3f8-1b96d1ea0cec None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:09.159915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14551e5a-2252-4b39-a3f8-1b96d1ea0cec None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:09.160189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14551e5a-2252-4b39-a3f8-1b96d1ea0cec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:09.237295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14551e5a-2252-4b39-a3f8-1b96d1ea0cec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:09.239108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14551e5a-2252-4b39-a3f8-1b96d1ea0cec None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:09.277732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c178b5-b96a-48e3-81d5-8b31c8ccda4e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:09.319550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:09.320804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:09.321161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:09.321443 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:09.322352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=039df81163264994a86fe2e98bb96983) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:09.322663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:09.324118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:09.331803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 326/674] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:09 2022] GET /identity/v3/role_assignments?user.id=039df81163264994a86fe2e98bb96983&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:09.332801 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:09.395462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 349/675] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:32:09.396804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14551e5a-2252-4b39-a3f8-1b96d1ea0cec None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:09.509250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303ff23-d8c6-4de7-8bd8-a24caf9fd7ef None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:09.580645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14551e5a-2252-4b39-a3f8-1b96d1ea0cec None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:09.585567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:09.586251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:09.586536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:09.586813 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:09.587686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=c789864ed513471fb6b367aecf236828) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:09.588001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:09.589463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:09.602438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 327/676] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:09 2022] GET /identity/v3/role_assignments?user.id=c789864ed513471fb6b367aecf236828&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:09.607456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:09.637591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:09.638660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:09.639180 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:09.639684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:09.640625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:09.641132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:09.642755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:09.661174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 350/677] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:09.668089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:09.735938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6ad5-5402-4a5f-a91f-3c2dc19998ca None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:09.816116 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:09.817264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:09.817750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:09.818230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:09.837480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:09.839347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:09.854027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df76d-e487-4782-a08b-c393d10b8a95 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:09.865003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:09.865928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:09.866892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:09.866892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:09.866892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:09.866892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:09.869620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 328/678] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:09.874726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:09.901280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:09.902086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:09.902419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:09.902703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:09.931457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:09.935129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:09.963431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:09.964424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:09.965393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:09.968746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 351/679] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:09.974509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:10.035660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a054843-b893-417b-8a83-ae7c1487d8df None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:10.073174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:10.074122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:10.074591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:10.075585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:10.076507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:10.077014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:10.078589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:10.089681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c20b-f1c7-431f-a7ec-04e4a421b11f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:10.094204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 329/680] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:10.101692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:10.133949 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:10.135238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:10.135238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:10.135238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:10.136027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:10.136339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:10.138989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:10.189732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 352/681] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 16:32:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:10.191289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:10.322198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897784-31a8-48b2-b903-eca657a02994 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:10.381550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:10.382470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:10.382816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:10.383205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:10.396701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:10.398424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:10.413939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:10.415143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:10.416064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:10.416064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:10.416064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:10.416064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:10.416064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:10.416064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:10.416064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:10.416064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:10.416952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 330/682] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:10.423118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:10.461316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae8ec6-ddfa-4490-9f30-5762895a07e7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:10.536169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9211-f082-4d67-81d8-9fe6340018cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:10.536870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9211-f082-4d67-81d8-9fe6340018cf None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:10.537163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9211-f082-4d67-81d8-9fe6340018cf None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:10.537451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9211-f082-4d67-81d8-9fe6340018cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:10.628303 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2894d-ec8a-4dd8-adfd-cf17f3126f2a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:10.697294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9211-f082-4d67-81d8-9fe6340018cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:10.701650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9211-f082-4d67-81d8-9fe6340018cf None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:10.703581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:10.704481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:10.704980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:10.705454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:10.706470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:10.707002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:10.709862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:10.738141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 331/683] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:10.742408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:10.887037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 353/684] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:32:10.888632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb3f3-2e70-472b-813e-3bec82016256 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:10.888820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb3f3-2e70-472b-813e-3bec82016256 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:10.889785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb3f3-2e70-472b-813e-3bec82016256 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:10.892077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846c20-826b-4ded-8f85-97eda60e1b57 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:10.895082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 354/685] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:10.896672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edb3f3-2e70-472b-813e-3bec82016256 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:10.941656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f77c50-6cda-4178-975e-2a945150a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:10.942823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77c50-6cda-4178-975e-2a945150a916 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:10.943421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77c50-6cda-4178-975e-2a945150a916 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:10.943983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77c50-6cda-4178-975e-2a945150a916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:10.945070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f77c50-6cda-4178-975e-2a945150a916 None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=05b1227b7f36498e8c1f1e27fa0ccb46) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:10.945566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f77c50-6cda-4178-975e-2a945150a916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:10.947255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f77c50-6cda-4178-975e-2a945150a916 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:10.955977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 332/686] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:10 2022] GET /identity/v3/role_assignments?user.id=05b1227b7f36498e8c1f1e27fa0ccb46&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:10.957741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30044-eb84-42d1-9e8e-80814a759cb5 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:10.958257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30044-eb84-42d1-9e8e-80814a759cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:10.959049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30044-eb84-42d1-9e8e-80814a759cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:10.992337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5cc30044-eb84-42d1-9e8e-80814a759cb5 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:10.993929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5cc30044-eb84-42d1-9e8e-80814a759cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:11.041847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edb3f3-2e70-472b-813e-3bec82016256 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:11.105898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:11.108656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:11.108656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:11.108656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:11.125957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:11.128151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:11.142942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 333/687] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:11.164943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:11.165937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:11.166832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:11.166832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:11.166832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:11.166832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:11.166832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 355/688] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:11.173518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30044-eb84-42d1-9e8e-80814a759cb5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:11.202385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:11.326001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161d95-42de-4403-90e2-d70ea92e0608 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:11.331904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30044-eb84-42d1-9e8e-80814a759cb5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:11.362510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a8925-14d2-47ff-8bf1-a0e674ca5ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:11.363343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8925-14d2-47ff-8bf1-a0e674ca5ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:11.364482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8925-14d2-47ff-8bf1-a0e674ca5ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:11.364758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a8925-14d2-47ff-8bf1-a0e674ca5ea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:11.372610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:11.373592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:11.374138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:11.374615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:11.375638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:11.376165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:11.376875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a8925-14d2-47ff-8bf1-a0e674ca5ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:11.377994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-910a8925-14d2-47ff-8bf1-a0e674ca5ea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:11.386902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:11.387944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:11.388787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 356/689] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:11.394623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a8925-14d2-47ff-8bf1-a0e674ca5ea9 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:11.397345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 334/690] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:11.407378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:11.536929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbac407-3e45-4e4f-869c-41705f50a96f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:11.574504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:11.576411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:11.576895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:11.577383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:11.581129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a8925-14d2-47ff-8bf1-a0e674ca5ea9 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:11.585072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:11.587571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:11.604370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:11.605314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:11.606253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:11.606253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:11.606253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:11.606253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:11.606253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:11.606253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:11.606253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:11.606253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:11.609055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 335/691] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:11.616165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:11.703698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:11.704421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:11.704705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:11.704978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:11.705877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:11.706067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:11.707622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:11.731227 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 357/692] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:11.737940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666e2b-bcde-4855-8e26-86e48a0130fc None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:11.739951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:11.779903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:11.781317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:11.781829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:11.782321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:11.783425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:11.784106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:11.785745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:11.800731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 336/693] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:11.806912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:11.928099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2c8f-b77b-4ae3-8bdf-da48744674dc None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:11.965895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:11.967244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:11.967760 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:11.968228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:11.969458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=5551a6e71bb0499d9161e6213acc0af9) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:11.969972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:11.971663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:11.979681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 337/694] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:11 2022] GET /identity/v3/role_assignments?user.id=5551a6e71bb0499d9161e6213acc0af9&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:12.069420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db0fa7-a18d-440b-8b3d-aa37385b2c1f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:12.145507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7066a-38d0-4e96-ab13-6317b5a22524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:12.146350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7066a-38d0-4e96-ab13-6317b5a22524 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.146633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7066a-38d0-4e96-ab13-6317b5a22524 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.146907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7066a-38d0-4e96-ab13-6317b5a22524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.165415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7066a-38d0-4e96-ab13-6317b5a22524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:12.166947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7066a-38d0-4e96-ab13-6317b5a22524 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-eed7066a-38d0-4e96-ab13-6317b5a22524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:12.195397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:12.196390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:12.197297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:12.197297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:12.197297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:12.197297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:12.203546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 358/695] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:12.212563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:12.334338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5e14f-afe5-43cc-907a-ce435b878c53 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:12.360898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32108927-c94f-497e-b72d-4ba39f50f6d3 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.361248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32108927-c94f-497e-b72d-4ba39f50f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.361460 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32108927-c94f-497e-b72d-4ba39f50f6d3 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.363056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 359/696] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:12.370428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b866a-1c5f-45e3-9298-019542b5067a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.370761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b866a-1c5f-45e3-9298-019542b5067a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.373187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b866a-1c5f-45e3-9298-019542b5067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.386632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:12.387724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.388211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.388683 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.389804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:12.390313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:12.391931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:12.402596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3b2b866a-1c5f-45e3-9298-019542b5067a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:12.405222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3b2b866a-1c5f-45e3-9298-019542b5067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:12.406496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 338/697] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:12.413470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:12.507905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 360/698] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:12.540200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b866a-1c5f-45e3-9298-019542b5067a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:12.566930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0f52a-9b16-4f9c-969f-fa67fd8cbead None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:12.617623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8f6ee-85b0-4082-84dd-d2cb5d376932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:12.618413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f6ee-85b0-4082-84dd-d2cb5d376932 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.618688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f6ee-85b0-4082-84dd-d2cb5d376932 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.618955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f6ee-85b0-4082-84dd-d2cb5d376932 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.630670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f6ee-85b0-4082-84dd-d2cb5d376932 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:12.632094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f6ee-85b0-4082-84dd-d2cb5d376932 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-dbd8f6ee-85b0-4082-84dd-d2cb5d376932 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:12.650494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:12.651630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:12.652655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:12.654629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 339/699] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:32:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:12.656163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb3a6-9e5d-4afb-9cd1-98a697ed6b3a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.656298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb3a6-9e5d-4afb-9cd1-98a697ed6b3a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.656462 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb3a6-9e5d-4afb-9cd1-98a697ed6b3a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.658070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 340/700] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:12.663096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeb3a6-9e5d-4afb-9cd1-98a697ed6b3a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:12.690440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b866a-1c5f-45e3-9298-019542b5067a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:12.732358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6e6ae-6ee1-447f-a9ee-fb105c0c036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:12.733512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6e6ae-6ee1-447f-a9ee-fb105c0c036c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.734152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6e6ae-6ee1-447f-a9ee-fb105c0c036c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.735080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6e6ae-6ee1-447f-a9ee-fb105c0c036c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.747749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6e6ae-6ee1-447f-a9ee-fb105c0c036c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:12.749523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6e6ae-6ee1-447f-a9ee-fb105c0c036c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-f1e6e6ae-6ee1-447f-a9ee-fb105c0c036c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:12.776182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:12.777162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:12.779447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:12.779447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:12.779447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:12.779447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:12.779447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 361/701] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:12.782053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d655b4-9c9d-46fb-8be3-70ea31968cdb None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.782332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d655b4-9c9d-46fb-8be3-70ea31968cdb None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.785531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d655b4-9c9d-46fb-8be3-70ea31968cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.811434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeb3a6-9e5d-4afb-9cd1-98a697ed6b3a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:12.814729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-94d655b4-9c9d-46fb-8be3-70ea31968cdb None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:12.815907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-94d655b4-9c9d-46fb-8be3-70ea31968cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:12.852753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:12.853812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:12.854313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:12.854787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:12.858650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:12.859226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:12.861458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:12.883870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 341/702] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:32:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:12.885551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:12.931662 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 362/703] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:12.932510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d655b4-9c9d-46fb-8be3-70ea31968cdb None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:13.024062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8509b4-b300-449f-959c-1d53c4fe6af4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:13.075193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d655b4-9c9d-46fb-8be3-70ea31968cdb None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:13.076921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:13.078588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:13.078588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:13.078588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:13.078839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:13.080979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:13.082113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:13.099642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 342/704] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:13.102290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:13.115825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eadc5-24a0-4f73-901f-69f626a4af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:13.119317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eadc5-24a0-4f73-901f-69f626a4af50 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:13.119839 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eadc5-24a0-4f73-901f-69f626a4af50 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:13.120343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eadc5-24a0-4f73-901f-69f626a4af50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:13.197124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7eadc5-24a0-4f73-901f-69f626a4af50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:13.199147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7eadc5-24a0-4f73-901f-69f626a4af50 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:13.246183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6c065-e1e4-47f7-b779-0ce04ec60723 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:13.290593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:13.291506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:13.291794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:13.292049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:13.292703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:13.294091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:13.304810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 363/705] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:32:13.306234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eadc5-24a0-4f73-901f-69f626a4af50 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:13.321088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:13.322113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:13.323121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:13.329436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 343/706] 10.222.0.57 () {56 vars in 1129 bytes} [Tue May 10 16:32:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:13.330318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:13.422452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eadc5-24a0-4f73-901f-69f626a4af50 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:13.485293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee9bc6-bfc0-4376-beed-15208dab6efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:13.485887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9bc6-bfc0-4376-beed-15208dab6efc None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:13.486165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9bc6-bfc0-4376-beed-15208dab6efc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:13.486438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9bc6-bfc0-4376-beed-15208dab6efc None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:13.487163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee9bc6-bfc0-4376-beed-15208dab6efc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:13.488600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee9bc6-bfc0-4376-beed-15208dab6efc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:13.490789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77900960-45dd-46bc-93eb-2af69d9169ac None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:13.518146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 364/707] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:32:13 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:13.518802 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee9bc6-bfc0-4376-beed-15208dab6efc None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:13.564957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:13.564957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:13.564957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:13.564957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:13.581655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:13.586054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:13.630665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:13.631711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:13.632915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:13.632915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:13.632915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:13.632915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:13.632915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 344/708] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:13.639713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:13.744958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee9bc6-bfc0-4376-beed-15208dab6efc None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:13.793698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:13.794387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:13.794928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:13.795251 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:13.795986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:13.796292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:13.797860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:13.813030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 365/709] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 16:32:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:13.818908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:13.866123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae84bb-8db9-4d95-bfc5-fa2565819db9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:13.911561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:13.913129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:13.913613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:13.914088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:13.915297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:13.915809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:13.920570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:13.936249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 345/710] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:13.944227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:13.992392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8030a-aa5a-49e3-91e7-4eef44dc666a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:14.030789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb882e-af50-4507-b507-8145d9fd4977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:14.032001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb882e-af50-4507-b507-8145d9fd4977 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.032478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb882e-af50-4507-b507-8145d9fd4977 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.032954 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb882e-af50-4507-b507-8145d9fd4977 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.033737 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb882e-af50-4507-b507-8145d9fd4977 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:14.034106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb882e-af50-4507-b507-8145d9fd4977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:14.037238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb882e-af50-4507-b507-8145d9fd4977 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:14.043541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 366/711] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 16:32:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:14.045224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3835af1-4ab0-4fc4-9b74-4fb09b04c8cf None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.045509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3835af1-4ab0-4fc4-9b74-4fb09b04c8cf None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.045782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3835af1-4ab0-4fc4-9b74-4fb09b04c8cf None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.049143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 367/712] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:14.056743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59da6-87ce-407e-a64e-1ec513e66233 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.056941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59da6-87ce-407e-a64e-1ec513e66233 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.057150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59da6-87ce-407e-a64e-1ec513e66233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.085678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4ee59da6-87ce-407e-a64e-1ec513e66233 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:14.086996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4ee59da6-87ce-407e-a64e-1ec513e66233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:14.092729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75825f-6c08-4796-a55a-84fdc4922563 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:14.159130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:14.160388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.160887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.161378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.176813 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:14.180605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:14.214494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:14.215561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:14.216451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:14.216451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:14.216451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:14.216451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:14.216451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:14.216451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:14.216451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:14.216451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:14.222408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 346/713] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:14.224231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 368/714] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:32:14.232330 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:14.267164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59da6-87ce-407e-a64e-1ec513e66233 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:14.410988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4a03-93a2-4a8a-93b9-1891c2fd455c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:14.462991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:14.462991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.462991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.462991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.463411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:14.463411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:14.466986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:14.488341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59da6-87ce-407e-a64e-1ec513e66233 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:14.507401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 347/715] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:14.516952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:14.567298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:14.568112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.570983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.570983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.570983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:14.570983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:14.607255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:14.608319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:14.609163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:14.611701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 369/716] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:14 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:14.617233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:14.740713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9fee4-4d43-4af9-8bdb-b7f3b1cab48c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:14.791736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:14.792409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.792695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.793188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.794869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=3d11d338bf2c4521bdfddc5d5c8da899) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:14.795214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:14.796658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:14.803438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 348/717] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:14 2022] GET /identity/v3/role_assignments?user.id=3d11d338bf2c4521bdfddc5d5c8da899&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:14.838993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5a076-a81d-4842-9b6e-4141c59b20d2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:14.879145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7a936-b279-4ab3-a2cd-ac3d0293160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:14.879834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a936-b279-4ab3-a2cd-ac3d0293160c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.880114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a936-b279-4ab3-a2cd-ac3d0293160c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.880384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a936-b279-4ab3-a2cd-ac3d0293160c None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.881108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7a936-b279-4ab3-a2cd-ac3d0293160c None admin] RBAC: Adding query filter params (name=network) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:14.881417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7a936-b279-4ab3-a2cd-ac3d0293160c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:14.882796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7a936-b279-4ab3-a2cd-ac3d0293160c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:14.888391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 370/718] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:14.896553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:14.950768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d47f-cf51-49ee-bd53-bcfe6a5391fd None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.950768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d47f-cf51-49ee-bd53-bcfe6a5391fd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.950768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d47f-cf51-49ee-bd53-bcfe6a5391fd None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.951264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 371/719] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:14.957096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79bc3-6f4a-4168-9f18-5c2e00311804 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:14.957418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79bc3-6f4a-4168-9f18-5c2e00311804 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:14.962987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79bc3-6f4a-4168-9f18-5c2e00311804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:14.991075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-2fd79bc3-6f4a-4168-9f18-5c2e00311804 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:14.991681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2fd79bc3-6f4a-4168-9f18-5c2e00311804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:15.083396 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafb76c-d3fa-456c-8218-80d5a315decc None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:15.118037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 372/720] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:32:15.130707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:15.131510 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:15.131858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:15.132205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:15.132993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:15.133370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:15.134805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:15.141422 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 349/721] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:15.155124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79bc3-6f4a-4168-9f18-5c2e00311804 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:15.262829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79bc3-6f4a-4168-9f18-5c2e00311804 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:15.298951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2cc13-dd55-4da4-a925-c3a67c6f4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:15.299780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2cc13-dd55-4da4-a925-c3a67c6f4754 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:15.302982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2cc13-dd55-4da4-a925-c3a67c6f4754 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:15.302982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2cc13-dd55-4da4-a925-c3a67c6f4754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:15.311284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2cc13-dd55-4da4-a925-c3a67c6f4754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-bda2cc13-dd55-4da4-a925-c3a67c6f4754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:15.319602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:15.320606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:15.321474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:15.326677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 373/722] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:15.327708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:15.438377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbeec9-d12f-46cb-8e40-4d9219e64fa4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:15.475030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:15.475701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:15.478998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:15.478998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:15.478998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:15.478998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:15.478998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:15.491085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 350/723] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:15.492993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2cc13-dd55-4da4-a925-c3a67c6f4754 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:15.599010 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2cc13-dd55-4da4-a925-c3a67c6f4754 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:15.655766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:15.656574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:15.656851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:15.657121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:15.684699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:15.686233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:15.715279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:15.716259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:15.717161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:15.717161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:15.717161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:15.717161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:15.718196 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 374/724] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:15.724215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:15.890408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce62f0f-46f1-4304-ba8c-8ffb69b3db3e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:15.962839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:15.963533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:15.963805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:15.964250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:15.965147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:15.965637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:15.967184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:15.994193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 351/725] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:16.003726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:16.258045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd76db7-a6b9-4354-99bf-f885d9ecb349 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:16.353851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:16.355220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:16.355709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:16.356758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:16.373346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:16.375993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:16.404281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:16.406120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:16.408053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 375/726] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:16.415004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:16.598424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1094d84-795d-4a2c-a1d2-c92cb6aa0d7f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:16.664811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0278ac-b411-44bc-b7bc-c422473b4c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:16.665491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0278ac-b411-44bc-b7bc-c422473b4c34 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:16.665766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0278ac-b411-44bc-b7bc-c422473b4c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:16.670988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0278ac-b411-44bc-b7bc-c422473b4c34 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:16.670988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0278ac-b411-44bc-b7bc-c422473b4c34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:16.670988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0278ac-b411-44bc-b7bc-c422473b4c34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:16.670988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0278ac-b411-44bc-b7bc-c422473b4c34 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:16.692588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 352/727] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 16:32:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:16.694469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:16.994766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdaa2a-0990-4363-a5b4-2fadafdbb856 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:17.098458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9a6c-f15c-458d-9d49-ea518e3b62e1 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:17.098926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9a6c-f15c-458d-9d49-ea518e3b62e1 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:17.099109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9a6c-f15c-458d-9d49-ea518e3b62e1 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:17.100757 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 353/728] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:17.106816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837f36-b825-4710-b82d-d45779d05656 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:17.107175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837f36-b825-4710-b82d-d45779d05656 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:17.107465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42837f36-b825-4710-b82d-d45779d05656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:17.109641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b6d46-1275-4b8d-bd31-e92a56103a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:17.111089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6d46-1275-4b8d-bd31-e92a56103a0e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:17.111912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6d46-1275-4b8d-bd31-e92a56103a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:17.112708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6d46-1275-4b8d-bd31-e92a56103a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:17.126320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-42837f36-b825-4710-b82d-d45779d05656 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:17.129743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-42837f36-b825-4710-b82d-d45779d05656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:17.211188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 354/729] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:32:17.231430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42837f36-b825-4710-b82d-d45779d05656 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:17.338994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b6d46-1275-4b8d-bd31-e92a56103a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:17.343042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b6d46-1275-4b8d-bd31-e92a56103a0e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:17.343310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42837f36-b825-4710-b82d-d45779d05656 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:17.378995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876c264-b69a-43c5-b073-36105ebb7cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:17.379286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876c264-b69a-43c5-b073-36105ebb7cff None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:17.379604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876c264-b69a-43c5-b073-36105ebb7cff None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:17.379747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876c264-b69a-43c5-b073-36105ebb7cff None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:17.380452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876c264-b69a-43c5-b073-36105ebb7cff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:17.381855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876c264-b69a-43c5-b073-36105ebb7cff None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:17.405863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 355/730] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:32:17 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:32:17.556156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86580786-c4d5-4941-af7e-779f7574fbc2 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:17.556373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86580786-c4d5-4941-af7e-779f7574fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:17.556676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86580786-c4d5-4941-af7e-779f7574fbc2 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:17.558166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 356/731] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:17.572591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b167-9a6a-47e0-ab28-efc7472246ec None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:17.572972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b167-9a6a-47e0-ab28-efc7472246ec None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:17.573201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b167-9a6a-47e0-ab28-efc7472246ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:17.596694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-66d3b167-9a6a-47e0-ab28-efc7472246ec None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:17.597932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-66d3b167-9a6a-47e0-ab28-efc7472246ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:17.608261 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 376/732] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 911 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:32:17.626086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b6d46-1275-4b8d-bd31-e92a56103a0e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:17.738401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 357/733] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:32:17.786920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3b167-9a6a-47e0-ab28-efc7472246ec None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:17.824764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b6d46-1275-4b8d-bd31-e92a56103a0e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:17.871012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:17.871012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:17.871012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:17.871012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:17.885624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:17.885624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:17.911022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:17.912636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:17.914328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:17.914328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:17.914328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:17.914328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:17.916014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 377/734] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:17.918951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:17.979975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3b167-9a6a-47e0-ab28-efc7472246ec None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:18.032964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dae6b7-c47a-478c-8173-f9dd538cb786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:18.034080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dae6b7-c47a-478c-8173-f9dd538cb786 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.034551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dae6b7-c47a-478c-8173-f9dd538cb786 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.035029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dae6b7-c47a-478c-8173-f9dd538cb786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.049802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dae6b7-c47a-478c-8173-f9dd538cb786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-b7dae6b7-c47a-478c-8173-f9dd538cb786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:18.058464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:18.059789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:18.060623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:18.063932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 358/735] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:18.070290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dae6b7-c47a-478c-8173-f9dd538cb786 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:18.240277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f21df9-f987-4d0a-ab4b-a7f431f93122 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:18.261497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dae6b7-c47a-478c-8173-f9dd538cb786 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:18.296259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7bb8c-91ae-4762-8c29-02c6816b1004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:18.297763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7bb8c-91ae-4762-8c29-02c6816b1004 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.299238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7bb8c-91ae-4762-8c29-02c6816b1004 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.299692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7bb8c-91ae-4762-8c29-02c6816b1004 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.303155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7bb8c-91ae-4762-8c29-02c6816b1004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:18.303693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7bb8c-91ae-4762-8c29-02c6816b1004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:18.305237 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7bb8c-91ae-4762-8c29-02c6816b1004 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:18.326467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 378/736] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:18.328888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850fc6d-a3b9-4f1d-b357-36643c4af861 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.332911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f248692-b9a2-4cfe-9286-5b96a7e0fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:18.333794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f248692-b9a2-4cfe-9286-5b96a7e0fc15 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.334587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f248692-b9a2-4cfe-9286-5b96a7e0fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.334835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850fc6d-a3b9-4f1d-b357-36643c4af861 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.335297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850fc6d-a3b9-4f1d-b357-36643c4af861 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.335729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f248692-b9a2-4cfe-9286-5b96a7e0fc15 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.337260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 379/737] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:18.338222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f248692-b9a2-4cfe-9286-5b96a7e0fc15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:18.338785 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f248692-b9a2-4cfe-9286-5b96a7e0fc15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:18.340927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f248692-b9a2-4cfe-9286-5b96a7e0fc15 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:18.341875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850fc6d-a3b9-4f1d-b357-36643c4af861 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:18.360735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 359/738] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:18.366560 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a183-c0ea-4614-ae9a-346e6da77d87 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.368565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a183-c0ea-4614-ae9a-346e6da77d87 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.369043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a183-c0ea-4614-ae9a-346e6da77d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.395541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-27e4a183-c0ea-4614-ae9a-346e6da77d87 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:18.396738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-27e4a183-c0ea-4614-ae9a-346e6da77d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:18.521863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 360/739] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:18.523619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a183-c0ea-4614-ae9a-346e6da77d87 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:18.556436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850fc6d-a3b9-4f1d-b357-36643c4af861 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:18.617536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:18.618333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.618615 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.618889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.629665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:18.631537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:18.661869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:18.662823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:18.663745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:18.663745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:18.663745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:18.663745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:18.663745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:18.663745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:18.663745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:18.663745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:18.665752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 380/740] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:18.665752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:18.690030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a183-c0ea-4614-ae9a-346e6da77d87 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:18.727628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:18.728799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.729466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.729967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.744516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:18.748169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:18.767304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:18.768245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:18.769137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:18.769137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:18.769137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:18.769137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:18.769137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 361/741] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:18.769881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:18.802194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a45ec-00ec-43c8-95d3-55e043348f2f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:18.840556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35e6e8-3692-4d46-994c-b5270f0afc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:18.841346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35e6e8-3692-4d46-994c-b5270f0afc72 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.841633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35e6e8-3692-4d46-994c-b5270f0afc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.841886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35e6e8-3692-4d46-994c-b5270f0afc72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.853758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35e6e8-3692-4d46-994c-b5270f0afc72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-0f35e6e8-3692-4d46-994c-b5270f0afc72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:18.860942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:18.861875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:18.864016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 381/742] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:18.864743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741dd9e-3168-450c-afb1-f1b4eafd54b7 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.864743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741dd9e-3168-450c-afb1-f1b4eafd54b7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.864743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741dd9e-3168-450c-afb1-f1b4eafd54b7 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.866122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 382/743] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:18.867071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741dd9e-3168-450c-afb1-f1b4eafd54b7 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:18.895751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788217d9-97b8-426a-a380-af1109bfc63e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:18.938625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:18.939608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:18.939893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:18.940172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:18.941198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:18.941912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:18.944091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:18.959618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 362/744] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:18.960459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:19.010033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741dd9e-3168-450c-afb1-f1b4eafd54b7 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:19.054177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ad384-8c90-40e6-b6bf-8b31b0422c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:19.054782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ad384-8c90-40e6-b6bf-8b31b0422c9e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:19.055135 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ad384-8c90-40e6-b6bf-8b31b0422c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:19.055416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ad384-8c90-40e6-b6bf-8b31b0422c9e None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:19.056368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ad384-8c90-40e6-b6bf-8b31b0422c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:19.056679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ad384-8c90-40e6-b6bf-8b31b0422c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:19.058049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ad384-8c90-40e6-b6bf-8b31b0422c9e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:19.072827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 383/745] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:19.074713 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40573-0172-4230-ad64-f04d3a74eae4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:19.083140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40573-0172-4230-ad64-f04d3a74eae4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:19.083140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40573-0172-4230-ad64-f04d3a74eae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:19.096849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b2e40573-0172-4230-ad64-f04d3a74eae4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:19.098342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b2e40573-0172-4230-ad64-f04d3a74eae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:19.099193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ce155-5fbb-4d56-a80b-ca2c391a70b4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:19.146791 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:19.148122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:19.148614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:19.149101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:19.150576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:19.151095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:19.152908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:19.167853 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 363/746] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:19.169297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:19.177890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 384/747] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:32:19.178721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40573-0172-4230-ad64-f04d3a74eae4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:19.302771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40573-0172-4230-ad64-f04d3a74eae4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:19.303567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f764a4-3917-41b4-b425-b4a63e001e44 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:19.342841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:19.344086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:19.344375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:19.344787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:19.352544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:19.353483 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:19.353994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:19.354185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:19.354425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:19.354726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:19.355627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=5551a6e71bb0499d9161e6213acc0af9) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:19.356500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:19.357935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:19.371109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 364/748] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:19 2022] GET /identity/v3/role_assignments?user.id=5551a6e71bb0499d9161e6213acc0af9&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:19.371109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:19.371468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:19.372336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 385/749] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:32:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:19.373294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:19.506408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e589b9d-b186-400f-8d41-3ba36b696373 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:19.524273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba36f2-cc71-47ac-ab6e-61a98b8b5da4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:19.572995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:19.573909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:19.574243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:19.574611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:19.575335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7ce5b-db06-43b6-b11f-d179d8f8e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:19.576263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7ce5b-db06-43b6-b11f-d179d8f8e755 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:19.576706 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7ce5b-db06-43b6-b11f-d179d8f8e755 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:19.577618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7ce5b-db06-43b6-b11f-d179d8f8e755 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:19.578721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7ce5b-db06-43b6-b11f-d179d8f8e755 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:19.580677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7ce5b-db06-43b6-b11f-d179d8f8e755 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:19.600698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 386/750] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:32:19 2022] POST /identity/v3/services => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:19.601651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7ce5b-db06-43b6-b11f-d179d8f8e755 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:19.739315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:19.741219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:19.761258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:19.763175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:19.764113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:19.764113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:19.764113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:19.764113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:19.768609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 365/751] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:19.776980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:19.835120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7ce5b-db06-43b6-b11f-d179d8f8e755 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:19.938715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:19.938715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:19.938715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:19.939263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:19.939853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:19.940165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:19.942369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:19.967818 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 387/752] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 16:32:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:19.973221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f2bf6-fec2-42e7-94f2-02eca2c87a5a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:19.979000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:20.018511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:20.019214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:20.019497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:20.019943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:20.020985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:20.021331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:20.022728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:20.039508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 366/753] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:20.044081 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:20.100549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de45c77-ed27-4483-a73f-18a789add0a9 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:20.136512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a849ae-e5b4-47d8-ac1b-4217b35985fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:20.137752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a849ae-e5b4-47d8-ac1b-4217b35985fb None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:20.138135 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a849ae-e5b4-47d8-ac1b-4217b35985fb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:20.138411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a849ae-e5b4-47d8-ac1b-4217b35985fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:20.155177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5389-a877-402c-98a9-8ce5425ed111 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:20.214991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038dfa3-2f55-4348-bd1b-0d394ff5cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:20.214991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038dfa3-2f55-4348-bd1b-0d394ff5cd28 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:20.214991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038dfa3-2f55-4348-bd1b-0d394ff5cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:20.214991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038dfa3-2f55-4348-bd1b-0d394ff5cd28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:20.234653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038dfa3-2f55-4348-bd1b-0d394ff5cd28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:20.236938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038dfa3-2f55-4348-bd1b-0d394ff5cd28 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-a038dfa3-2f55-4348-bd1b-0d394ff5cd28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:20.256646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:20.257632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:20.258571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 367/754] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:32:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:20.264802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828a66-0732-4eb1-b2d2-198b0d421e74 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:20.265094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828a66-0732-4eb1-b2d2-198b0d421e74 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:20.265377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc828a66-0732-4eb1-b2d2-198b0d421e74 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:20.271695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 368/755] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:20 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:20.272551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc828a66-0732-4eb1-b2d2-198b0d421e74 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:20.284417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a849ae-e5b4-47d8-ac1b-4217b35985fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:20.287086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a849ae-e5b4-47d8-ac1b-4217b35985fb None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:20.407877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 388/756] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:32:20.410010 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68aa6-f72c-4ca5-9bce-08fb2f74f3c3 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:20.410475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68aa6-f72c-4ca5-9bce-08fb2f74f3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:20.411406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68aa6-f72c-4ca5-9bce-08fb2f74f3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:20.431972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f0e68aa6-f72c-4ca5-9bce-08fb2f74f3c3 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:20.433592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f0e68aa6-f72c-4ca5-9bce-08fb2f74f3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:20.520113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc828a66-0732-4eb1-b2d2-198b0d421e74 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:20.564253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:20.565300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:20.565786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:20.566302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:20.567411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:20.567744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 389/757] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:20.568902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e68aa6-f72c-4ca5-9bce-08fb2f74f3c3 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:20.569446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:20.571743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:20.604108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 369/758] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:32:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:20.605280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:20.728546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e68aa6-f72c-4ca5-9bce-08fb2f74f3c3 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:20.750454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe88a-63c0-47cd-8676-243c338265c4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:20.767697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:20.768972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:20.769546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:20.770246 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:20.789951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:20.793923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:20.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:20.822553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:20.823526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:20.823526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:20.823526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:20.823526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:20.830581 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 390/759] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:20.831992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:20.834320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:20.835336 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:20.835780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:20.837033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:20.837822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:20.841113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:20.861561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:20.862566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:20.863470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:20.867122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 370/760] 10.222.0.57 () {56 vars in 1129 bytes} [Tue May 10 16:32:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:20.868223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:20.996995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828ab9-f0fc-44a1-ab03-5f5e80bfaa7e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:21.048917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb92f-305a-4624-a681-f66f0a407167 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:21.066133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:21.068102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.068393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.068837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.098892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:21.100378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:21.127466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:21.128386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:21.129272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:21.129272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:21.129272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:21.129272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:21.135538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 391/761] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:21.136839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:21.137611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.137908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.138203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.138956 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:21.139346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:21.140781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:21.144910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:21.169477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 371/762] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:21.170590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:21.321518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497a74-c339-42ca-8afb-c59346ed9cb4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:21.374987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b3ef-ecc6-4f49-bd06-767dc33098bf None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:21.415000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:21.415000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.415000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.415000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.415834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:21.415834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:21.415834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:21.422989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:21.422989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.422989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.422989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.423328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:21.423328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:21.423328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:21.426981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 392/763] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 16:32:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:21.426981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:21.455699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 372/764] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:21.458983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:21.595077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acbb6b-539b-4e0d-8f28-4ea0bca44af1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:21.622992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284795d7-0d03-4366-9aad-51aa04747558 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:21.666987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:21.666987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.666987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.666987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.667402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:21.667402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:21.674994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:21.690992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 373/765] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 16:32:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:21.690992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:21.706996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:21.710990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.710990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.710990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.722985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:21.722985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:21.754988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:21.755942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 393/766] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:21.756851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:21.836645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a39ed-4a6d-469b-8f3e-cc0a4059b8f1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:21.875066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:21.875066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.875066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.875066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.886987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:21.886987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:21.902992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:21.903926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:21.904828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:21.904828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:21.904828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:21.904828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:21.904828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:21.904828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:21.904828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:21.904828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:21.905263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d113e1-3b8f-4e79-a068-53a13a849b61 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:21.911004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 374/767] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:21.911004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:21.950990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d739e1-86e0-46e8-a13c-9efc6e8a9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:21.950990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d739e1-86e0-46e8-a13c-9efc6e8a9568 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.950990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d739e1-86e0-46e8-a13c-9efc6e8a9568 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.950990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d739e1-86e0-46e8-a13c-9efc6e8a9568 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.958985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d739e1-86e0-46e8-a13c-9efc6e8a9568 None admin] RBAC: Adding query filter params (interface=public, service_id=67846e5818f24015b35d5813c627e949, region_id=RegionOne) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:21.958985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d739e1-86e0-46e8-a13c-9efc6e8a9568 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:21.958985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d739e1-86e0-46e8-a13c-9efc6e8a9568 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:21.974986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 394/768] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 16:32:21 2022] GET /identity/v3/endpoints?service_id=67846e5818f24015b35d5813c627e949&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:21.974986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577f70-023c-4a68-b026-763afc1a99dd None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:21.974986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577f70-023c-4a68-b026-763afc1a99dd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:21.974986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577f70-023c-4a68-b026-763afc1a99dd None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:21.974986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 395/769] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:21.974986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba577f70-023c-4a68-b026-763afc1a99dd None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:22.042985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11357e46-20f2-41f4-8c86-63a35b82b8f2 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:22.078987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:22.078987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.078987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.078987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.079423 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:22.079423 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:22.079423 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:22.088391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 375/770] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:22.091339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:22.109821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba577f70-023c-4a68-b026-763afc1a99dd None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:22.160334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590004a-1392-433c-b9e0-3e087545d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:22.161003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590004a-1392-433c-b9e0-3e087545d24c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.161290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590004a-1392-433c-b9e0-3e087545d24c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.161560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590004a-1392-433c-b9e0-3e087545d24c None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.163455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590004a-1392-433c-b9e0-3e087545d24c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:22.163776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590004a-1392-433c-b9e0-3e087545d24c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:22.165735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590004a-1392-433c-b9e0-3e087545d24c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:22.180851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 396/771] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:22.182120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482f58c-0f91-424c-8573-5e941917a638 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.182408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482f58c-0f91-424c-8573-5e941917a638 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.182689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482f58c-0f91-424c-8573-5e941917a638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.205308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7482f58c-0f91-424c-8573-5e941917a638 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:22.206478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7482f58c-0f91-424c-8573-5e941917a638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:22.243751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582037da-0a2c-486f-8561-b29315c0ed10 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:22.298985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 397/772] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:22.298985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482f58c-0f91-424c-8573-5e941917a638 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:22.305182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c3e01-602c-4c14-a04d-890eeba5dcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:22.310984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3e01-602c-4c14-a04d-890eeba5dcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.310984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3e01-602c-4c14-a04d-890eeba5dcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.310984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3e01-602c-4c14-a04d-890eeba5dcd8 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.310984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c3e01-602c-4c14-a04d-890eeba5dcd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:22.310984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c3e01-602c-4c14-a04d-890eeba5dcd8 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:22.316088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 376/773] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:32:22 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:22.316833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c3e01-602c-4c14-a04d-890eeba5dcd8 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:22.416681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482f58c-0f91-424c-8573-5e941917a638 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:22.462706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c3e01-602c-4c14-a04d-890eeba5dcd8 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:22.464404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d285c-ba9e-456b-988f-cff868e517ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:22.466191 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d285c-ba9e-456b-988f-cff868e517ee None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.466632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d285c-ba9e-456b-988f-cff868e517ee None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.467997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d285c-ba9e-456b-988f-cff868e517ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.471289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d285c-ba9e-456b-988f-cff868e517ee None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=09a9cf0f43624be493e7092f3a4a8f80) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:22.471471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d285c-ba9e-456b-988f-cff868e517ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:22.475595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d285c-ba9e-456b-988f-cff868e517ee None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:22.489926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 398/774] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:22 2022] GET /identity/v3/role_assignments?user.id=09a9cf0f43624be493e7092f3a4a8f80&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:22.491846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15744-e379-45db-851a-8619c74e10cf None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.492309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15744-e379-45db-851a-8619c74e10cf None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.492752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15744-e379-45db-851a-8619c74e10cf None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.494365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 399/775] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:22.495459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15744-e379-45db-851a-8619c74e10cf None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:22.509783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ac01f-dd3d-4c2f-8c54-dea74ee34541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:22.510695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ac01f-dd3d-4c2f-8c54-dea74ee34541 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.510999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ac01f-dd3d-4c2f-8c54-dea74ee34541 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.511272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ac01f-dd3d-4c2f-8c54-dea74ee34541 None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/3d11d338bf2c4521bdfddc5d5c8da899/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.513563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ac01f-dd3d-4c2f-8c54-dea74ee34541 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=3d11d338bf2c4521bdfddc5d5c8da899, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:22.515073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ac01f-dd3d-4c2f-8c54-dea74ee34541 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:22.545945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 377/776] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:22 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/3d11d338bf2c4521bdfddc5d5c8da899/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:32:22.545945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a74e7-3dd6-4b91-8dce-e72ac7ff9387 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.545945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a74e7-3dd6-4b91-8dce-e72ac7ff9387 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.545945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a74e7-3dd6-4b91-8dce-e72ac7ff9387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.566529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-306a74e7-3dd6-4b91-8dce-e72ac7ff9387 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:22.568441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-306a74e7-3dd6-4b91-8dce-e72ac7ff9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:22.663660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15744-e379-45db-851a-8619c74e10cf None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:22.685848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 378/777] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:22.712369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375f4d-dcbe-4fe4-ad0b-f0b46a8ed0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:22.713912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375f4d-dcbe-4fe4-ad0b-f0b46a8ed0ee None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.714544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375f4d-dcbe-4fe4-ad0b-f0b46a8ed0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.714991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375f4d-dcbe-4fe4-ad0b-f0b46a8ed0ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.719570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a74e7-3dd6-4b91-8dce-e72ac7ff9387 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:22.728600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375f4d-dcbe-4fe4-ad0b-f0b46a8ed0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-77375f4d-dcbe-4fe4-ad0b-f0b46a8ed0ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:22.737679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:22.738791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:22.739681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:22.743420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 400/778] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:22.745447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375f4d-dcbe-4fe4-ad0b-f0b46a8ed0ee None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:22.857736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375f4d-dcbe-4fe4-ad0b-f0b46a8ed0ee None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:22.899000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:22.899229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:22.901258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:22.901258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:22.906986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:22.906986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:22.910991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:22.929854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 401/779] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:22.935001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a74e7-3dd6-4b91-8dce-e72ac7ff9387 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:22.939044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:23.014987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:23.014987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:23.014987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:23.014987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] PATH_INFO: `/v3/services/network` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:23.018984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:23.022990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:23.056309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:23.057355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:23.058194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:23.071332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 379/780] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:22 2022] GET /identity/v3/services/network => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:23.071332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:23.169392 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def72712-9ed0-42f1-b20e-c8a620566d52 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:23.187536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb52028-4f03-4c21-9ff9-7a0c3ab9c858 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:23.207099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:23.215055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:23.215055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:23.215055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:23.215055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] RBAC: Adding query filter params (name=network) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:23.215055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:23.215055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:23.222014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 380/781] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:23.224713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:23.298997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:23.298997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:23.298997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:23.298997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:23.322991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:23.322991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:23.358993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:23.359948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:23.360865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:23.360865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:23.360865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:23.360865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:23.365141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 402/782] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:23.365141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:23.398989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34d7d5-416c-4d95-a3a6-f3236960f788 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:23.463064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:23.463064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:23.463064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:23.463064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:23.465307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] RBAC: Adding query filter params (type=network) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:23.465307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:23.470985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:23.479267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 381/783] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:23.482991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:23.634990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52012-1f73-497d-89a1-0bd45d58e39c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:23.650983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1ecd-db4c-4048-882d-65c3a7ecd642 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:23.692554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:23.693274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:23.693647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:23.693927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:23.694706 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:23.695042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:23.696401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:23.705764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:23.706424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:23.706704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:23.706991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:23.707792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] RBAC: Adding query filter params (interface=public, service_id=51e9f92fd826499d8d741c2134aaa78a, region_id=RegionOne) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:23.708098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:23.709225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 403/784] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:23.709457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:23.714530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:23.726559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 382/785] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 16:32:23 2022] GET /identity/v3/endpoints?service_id=51e9f92fd826499d8d741c2134aaa78a&interface=public®ion_id=RegionOne => generated 194 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:23.732171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:23.817416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e835a1-d692-4026-97c5-ae8865be543a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:23.852891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:23.853689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:23.853967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:23.854236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:23.862819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:23.864992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:23.866565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd75d-bc2c-401d-b106-1f0b391105d8 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:23.890768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:23.891738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:23.892748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:23.895345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 404/786] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:23.900314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:23.966878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e059fe-f8f8-4eb8-8236-aa076b4efced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:23.968361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e059fe-f8f8-4eb8-8236-aa076b4efced None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:23.968856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e059fe-f8f8-4eb8-8236-aa076b4efced None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:23.969342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e059fe-f8f8-4eb8-8236-aa076b4efced None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:23.970225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e059fe-f8f8-4eb8-8236-aa076b4efced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:23.971822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e059fe-f8f8-4eb8-8236-aa076b4efced None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:23.978237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 383/787] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:32:23 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:24.021608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987ba7b-0609-40ac-979e-2aa604c6653c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:24.059185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:24.060234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:24.060718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:24.061194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:24.062235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:24.062764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:24.064394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:24.083519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 405/788] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 16:32:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:24.092237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e059fe-f8f8-4eb8-8236-aa076b4efced None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:24.206084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e059fe-f8f8-4eb8-8236-aa076b4efced None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:24.242631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:24.243364 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:24.243644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:24.243923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:24.261259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:24.262781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:24.291692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:24.292659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:24.294090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:24.294090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:24.294090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:24.294090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:24.298018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 384/789] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:24.299326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:24.409960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf0fbe-723f-4dc3-b602-089f9b97d35f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:24.445993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:24.446661 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:24.446942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:24.447260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:24.447985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:24.448289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:24.449854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:24.461366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 406/790] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:24.466977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:24.594460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f996cc-1e29-4708-b556-d6a4bd3424e9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:24.658279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:24.658279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:24.658279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:24.658864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:24.670702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:24.672182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:24.701736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:24.702715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:24.703659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 385/791] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:24.709665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:24.875066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf108d3-4c26-4840-a2f2-304f1b4cbee1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:24.916814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5c9f-9d7c-4b65-959f-2ac0059122e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:24.917485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5c9f-9d7c-4b65-959f-2ac0059122e3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:24.917771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5c9f-9d7c-4b65-959f-2ac0059122e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:24.918108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5c9f-9d7c-4b65-959f-2ac0059122e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:24.920569 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5c9f-9d7c-4b65-959f-2ac0059122e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:24.920889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5c9f-9d7c-4b65-959f-2ac0059122e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:24.922324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5c9f-9d7c-4b65-959f-2ac0059122e3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:24.939239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 407/792] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:24.942995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:25.171499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86923dc3-bd5b-4254-96ec-d367d98e89e6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:25.249180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea607018-ae91-4345-aa98-e735747449f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:25.250083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607018-ae91-4345-aa98-e735747449f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.250362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607018-ae91-4345-aa98-e735747449f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.250633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607018-ae91-4345-aa98-e735747449f6 None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/5551a6e71bb0499d9161e6213acc0af9/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.256326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea607018-ae91-4345-aa98-e735747449f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=5551a6e71bb0499d9161e6213acc0af9, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:25.257789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea607018-ae91-4345-aa98-e735747449f6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:25.285812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 386/793] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:24 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/5551a6e71bb0499d9161e6213acc0af9/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:32:25.309636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98f7c7-f29f-4173-a3f7-543e72a81b81 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.309949 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98f7c7-f29f-4173-a3f7-543e72a81b81 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.310182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98f7c7-f29f-4173-a3f7-543e72a81b81 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.311915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 408/794] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:25.317575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93071-6bbc-459c-80ed-e6deb5bb3ff7 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.317883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93071-6bbc-459c-80ed-e6deb5bb3ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.318130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93071-6bbc-459c-80ed-e6deb5bb3ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.352302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-9ad93071-6bbc-459c-80ed-e6deb5bb3ff7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:25.353563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9ad93071-6bbc-459c-80ed-e6deb5bb3ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:25.364173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cabf-43f0-46ff-ba37-d7f4957606c7 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.364511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cabf-43f0-46ff-ba37-d7f4957606c7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.364720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cabf-43f0-46ff-ba37-d7f4957606c7 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.367545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 409/795] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:25.374057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d813-e452-446e-8460-1ba899edbf99 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.374337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d813-e452-446e-8460-1ba899edbf99 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.374619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d813-e452-446e-8460-1ba899edbf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.399274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-05a2d813-e452-446e-8460-1ba899edbf99 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:25.400564 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-05a2d813-e452-446e-8460-1ba899edbf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:25.479478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 387/796] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:25.481025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0510-b3b4-4c7c-b318-a54ec9024488 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.484207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0510-b3b4-4c7c-b318-a54ec9024488 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.484207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0510-b3b4-4c7c-b318-a54ec9024488 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.489062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 388/797] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:25.497360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905000d-3c62-47ba-a1ea-a171482d9c05 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.498002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905000d-3c62-47ba-a1ea-a171482d9c05 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.498631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905000d-3c62-47ba-a1ea-a171482d9c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.532646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1905000d-3c62-47ba-a1ea-a171482d9c05 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:25.533292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 410/798] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:25.533968 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d813-e452-446e-8460-1ba899edbf99 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:25.534862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1905000d-3c62-47ba-a1ea-a171482d9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:25.633535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 389/799] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:25.635159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905000d-3c62-47ba-a1ea-a171482d9c05 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:25.650434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d813-e452-446e-8460-1ba899edbf99 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:25.688565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6ae2-3354-4814-acfc-44719eba93d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:25.689369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6ae2-3354-4814-acfc-44719eba93d7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.689869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6ae2-3354-4814-acfc-44719eba93d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.689869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6ae2-3354-4814-acfc-44719eba93d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.700751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc6ae2-3354-4814-acfc-44719eba93d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-8edc6ae2-3354-4814-acfc-44719eba93d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:25.708510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:25.709462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 411/800] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:25.710829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6ae2-3354-4814-acfc-44719eba93d7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:25.753863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905000d-3c62-47ba-a1ea-a171482d9c05 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:25.788045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b41dcc-a622-4196-9a30-9a8d18c478b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:25.789252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b41dcc-a622-4196-9a30-9a8d18c478b7 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.789734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b41dcc-a622-4196-9a30-9a8d18c478b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.790218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b41dcc-a622-4196-9a30-9a8d18c478b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.801745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b41dcc-a622-4196-9a30-9a8d18c478b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-b0b41dcc-a622-4196-9a30-9a8d18c478b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:25.810673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:25.811806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:25.812682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:25.815407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 390/801] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:25.815932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6ae2-3354-4814-acfc-44719eba93d7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:25.816645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b41dcc-a622-4196-9a30-9a8d18c478b7 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:25.853992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:25.854805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.855125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.855399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.856605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:25.857970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:25.870101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:25.871104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:25.872617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 412/802] 10.222.0.57 () {56 vars in 1129 bytes} [Tue May 10 16:32:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:25.874071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:25.939282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b41dcc-a622-4196-9a30-9a8d18c478b7 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:25.971862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:25.972519 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:25.972797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:25.973068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:25.973885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:25.974094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:25.975493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:25.986526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e352-2d25-4bcd-840f-df22e54643d1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:25.988711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 391/803] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:25.989820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.027979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.029341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.029830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.030652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.032131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:26.032891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.035002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.046496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 413/804] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:26.047547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.093510 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b996d-1005-48f4-a313-1fffc0210e65 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.126878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.127625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.127911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.128185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.129045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:26.129241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.130563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.136320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 392/805] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 16:32:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:26.137263 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.171901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b2d09-2ad9-499f-a7a2-8223d4e5b10c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.208610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.209363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.209650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.209924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.220701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.222149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:26.239829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:26.240779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:26.241669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:26.241669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:26.241669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:26.241669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:26.245690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 414/806] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:26.247176 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.259418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9162746-91b0-44d0-8dbe-59fe931de0ef None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.300118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.301114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.301404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.301808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.313231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.314845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:26.332588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:26.333702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:26.334792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:26.334792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:26.334792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:26.334792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:26.338498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 393/807] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:26.339317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.365450 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6dd90-f76c-450f-8ebd-38b3adcd946e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.408760 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.409940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.410372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.410794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.412562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:26.413055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.414565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.421332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 415/808] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 16:32:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:26.422307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.447447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5941-d5ea-49cd-be00-1cf92f7e8392 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.490323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.491276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.491719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.492138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.493166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:26.494111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.495929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.515421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 394/809] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:26.516271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.535157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07cf53-7427-4017-a076-972012ba45a1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.574705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.575612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.575984 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.576359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.577222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:26.577634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.579140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.595948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 416/810] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:26.596971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.631945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaaf9e-f707-4773-8dc7-75e5505c7dbe None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.680192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee317b9-c8d5-416c-adfd-ff458ab2c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.681282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee317b9-c8d5-416c-adfd-ff458ab2c2ae None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.682462 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee317b9-c8d5-416c-adfd-ff458ab2c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.682889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee317b9-c8d5-416c-adfd-ff458ab2c2ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.684383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee317b9-c8d5-416c-adfd-ff458ab2c2ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.685894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee317b9-c8d5-416c-adfd-ff458ab2c2ae None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.713824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 395/811] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:32:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:26.714906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee317b9-c8d5-416c-adfd-ff458ab2c2ae None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.720314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bd453-5529-4b9e-9047-c376c6e22c53 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.821444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabb2b0-c8d8-42f7-85aa-23f1c2ee28ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.823259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb2b0-c8d8-42f7-85aa-23f1c2ee28ec None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.824611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb2b0-c8d8-42f7-85aa-23f1c2ee28ec None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.826380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb2b0-c8d8-42f7-85aa-23f1c2ee28ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.837740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabb2b0-c8d8-42f7-85aa-23f1c2ee28ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.839525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabb2b0-c8d8-42f7-85aa-23f1c2ee28ec None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-aeabb2b0-c8d8-42f7-85aa-23f1c2ee28ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:26.856288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:26.857503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:26.858531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:26.860792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 417/812] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:32:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:26.862296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964e5e0-5664-4a45-8b9c-4e13f64106b7 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.862726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964e5e0-5664-4a45-8b9c-4e13f64106b7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.863191 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964e5e0-5664-4a45-8b9c-4e13f64106b7 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.864590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 418/813] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:26.867084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964e5e0-5664-4a45-8b9c-4e13f64106b7 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:26.881835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee317b9-c8d5-416c-adfd-ff458ab2c2ae None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:26.923953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f586505-194f-4592-9e98-d5d80c298933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:26.925471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586505-194f-4592-9e98-d5d80c298933 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.925471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586505-194f-4592-9e98-d5d80c298933 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.925644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586505-194f-4592-9e98-d5d80c298933 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.934497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f586505-194f-4592-9e98-d5d80c298933 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:26.935962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f586505-194f-4592-9e98-d5d80c298933 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-0f586505-194f-4592-9e98-d5d80c298933 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:26.950634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:26.951646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:26.952595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 396/814] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:32:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:26.954474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987a22-6301-4f3e-a5e0-96aae841934f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:26.954474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987a22-6301-4f3e-a5e0-96aae841934f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:26.954474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16987a22-6301-4f3e-a5e0-96aae841934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:26.972693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-16987a22-6301-4f3e-a5e0-96aae841934f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:26.973859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-16987a22-6301-4f3e-a5e0-96aae841934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:27.003249 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964e5e0-5664-4a45-8b9c-4e13f64106b7 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.038023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.038739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.039054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.039381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.040394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:27.040703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.042203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.054544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 397/815] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:27.055552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16987a22-6301-4f3e-a5e0-96aae841934f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.061678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 419/816] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:32:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:27.067052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.153596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16987a22-6301-4f3e-a5e0-96aae841934f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.167380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e25d65-910b-48d2-82d6-e042e86fb1f4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.188835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.189547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.189827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.190096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.191150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:27.191456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.192949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.203985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895d17b-5152-4a6a-93a3-aa085843e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.204688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d17b-5152-4a6a-93a3-aa085843e266 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.204971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d17b-5152-4a6a-93a3-aa085843e266 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.205245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d17b-5152-4a6a-93a3-aa085843e266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.210990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 398/817] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:27.211911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.276560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895d17b-5152-4a6a-93a3-aa085843e266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.278582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895d17b-5152-4a6a-93a3-aa085843e266 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.342290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2323f46-25ee-4412-b1dd-34d17159590f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.382583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.383430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.383955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.384237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] PATH_INFO: `/v3/services/network` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.384895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.387263 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.395630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 420/818] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 16:32:27.396759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895d17b-5152-4a6a-93a3-aa085843e266 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:27.401025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:27.402022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:27.403564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 399/819] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:27.405010 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.502220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895d17b-5152-4a6a-93a3-aa085843e266 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.533211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7007b-efb7-4e83-8e9d-96e3f6267fff None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.539450 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.540486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.540974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.541449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.552327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.554060 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.572546 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.573406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.573692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.573967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:27.576298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:27.577198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:27.578096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:27.578096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:27.578096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:27.578096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:27.581272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 421/820] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:27.582325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.591408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.593346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:27.615572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:27.616559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:27.617476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:27.617476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:27.617476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:27.617476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:27.619101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 400/821] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:27.620165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.703833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850faf4-7df0-4132-be8c-e447f0f609f9 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.718866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964cbeb-fd77-40cf-98a5-e7dfc9421ad1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.735618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.736285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.736565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.736837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.737539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] RBAC: Adding query filter params (name=network) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:27.737841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.739217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.748524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 422/822] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:27.748524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.755596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e0a9-59ea-4275-b8ec-08c65e5e5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.756260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e0a9-59ea-4275-b8ec-08c65e5e5689 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.756543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e0a9-59ea-4275-b8ec-08c65e5e5689 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.756820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e0a9-59ea-4275-b8ec-08c65e5e5689 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.757544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e0a9-59ea-4275-b8ec-08c65e5e5689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:27.757849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e0a9-59ea-4275-b8ec-08c65e5e5689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.759235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e0a9-59ea-4275-b8ec-08c65e5e5689 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.771142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 401/823] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:27.772402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c529-f630-4e60-84c8-345a63ffe096 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.772689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c529-f630-4e60-84c8-345a63ffe096 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.772993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c529-f630-4e60-84c8-345a63ffe096 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.774307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 402/824] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:27.774837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c529-f630-4e60-84c8-345a63ffe096 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:27.845669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b33be4-ed35-497c-9b15-cd0753f2d387 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.884562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c529-f630-4e60-84c8-345a63ffe096 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:27.886509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d51e57-c5ed-4319-ad9d-34ff53b1af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.887799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51e57-c5ed-4319-ad9d-34ff53b1af9e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.888081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51e57-c5ed-4319-ad9d-34ff53b1af9e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.888358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51e57-c5ed-4319-ad9d-34ff53b1af9e None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.889077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d51e57-c5ed-4319-ad9d-34ff53b1af9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:27.889385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d51e57-c5ed-4319-ad9d-34ff53b1af9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.890749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d51e57-c5ed-4319-ad9d-34ff53b1af9e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.906357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 423/825] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:27.906357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa733-d410-438c-bf0f-f966b4a07214 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.906357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa733-d410-438c-bf0f-f966b4a07214 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.906357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa733-d410-438c-bf0f-f966b4a07214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.919445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-199aa733-d410-438c-bf0f-f966b4a07214 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:27.920894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-199aa733-d410-438c-bf0f-f966b4a07214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:27.924207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:27.924864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:27.925141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:27.925415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:27.926117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] RBAC: Adding query filter params (type=network) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:27.926423 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:27.927805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:27.937628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 403/826] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:27.937628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.007048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 424/827] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:28.007048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa733-d410-438c-bf0f-f966b4a07214 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.048130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9ec0c-353d-4d2e-bb49-eb750b4c72ea None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.082137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.082930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.083246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.083521 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.091719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.093181 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:28.107156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:28.108036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:28.108926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 404/828] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:28.109422 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.112915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa733-d410-438c-bf0f-f966b4a07214 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.148385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.149187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.149483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.149746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.157447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.159559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:28.179052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:28.180011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:28.180917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:28.180917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:28.180917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:28.180917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:28.180917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:28.180917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:28.180917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:28.180917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:28.187583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 425/829] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:28.187583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.211961 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0d3d1-5438-4c7d-b71d-f67ebe021d6a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.244077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98aff4-53f2-4ce4-8320-d2c6549143a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.244727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98aff4-53f2-4ce4-8320-d2c6549143a0 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.245033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98aff4-53f2-4ce4-8320-d2c6549143a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.245287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98aff4-53f2-4ce4-8320-d2c6549143a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.246014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98aff4-53f2-4ce4-8320-d2c6549143a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.248037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98aff4-53f2-4ce4-8320-d2c6549143a0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.273566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 405/830] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:32:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:28.273566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98aff4-53f2-4ce4-8320-d2c6549143a0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.300190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b8aff-a571-4e05-883f-93f12f060a27 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.342348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f74c-8960-42b5-96eb-613dddf946c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.343199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f74c-8960-42b5-96eb-613dddf946c4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.343481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f74c-8960-42b5-96eb-613dddf946c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.343752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f74c-8960-42b5-96eb-613dddf946c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.359903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37f74c-8960-42b5-96eb-613dddf946c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-ae37f74c-8960-42b5-96eb-613dddf946c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:28.371265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:28.372322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:28.373158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:28.380068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 426/831] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:28.381174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f74c-8960-42b5-96eb-613dddf946c4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.407685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98aff4-53f2-4ce4-8320-d2c6549143a0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.446528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.447610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.448103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.448637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.449820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:28.450351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.452050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.466428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 406/832] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:28.467705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.519964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f74c-8960-42b5-96eb-613dddf946c4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.562789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.563428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.563715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.563989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.564778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:28.565086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.566521 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.579247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 427/833] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:28.580412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.594869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f9a0-1dd5-4e4b-b6e7-8c691ba4ee27 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.627817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.628491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.628788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.629048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.629796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:28.630101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.631504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.644086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 407/834] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:28.644086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.685165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a3039-feaa-4311-aef0-a6b75fcc4aef None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.718940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc2258-d980-4826-9dc2-4ecf1aae1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.720011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc2258-d980-4826-9dc2-4ecf1aae1656 None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.720354 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc2258-d980-4826-9dc2-4ecf1aae1656 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.720629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc2258-d980-4826-9dc2-4ecf1aae1656 None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/09a9cf0f43624be493e7092f3a4a8f80/roles/03a8445ffd574dc38f0948d45ce527b7` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.735941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc2258-d980-4826-9dc2-4ecf1aae1656 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=09a9cf0f43624be493e7092f3a4a8f80, role_id=03a8445ffd574dc38f0948d45ce527b7)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.737923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc2258-d980-4826-9dc2-4ecf1aae1656 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.739461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f20094-42a0-437d-aced-cf8a176653ba None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.762999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 428/835] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:28 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/09a9cf0f43624be493e7092f3a4a8f80/roles/03a8445ffd574dc38f0948d45ce527b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:32:28.762999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc2258-d980-4826-9dc2-4ecf1aae1656 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:28.787550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.788434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.788827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.789203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.790130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=3d11d338bf2c4521bdfddc5d5c8da899) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:28.790512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.792216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.799650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 408/836] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:28 2022] GET /identity/v3/role_assignments?user.id=3d11d338bf2c4521bdfddc5d5c8da899&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:28.875371 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc2258-d980-4826-9dc2-4ecf1aae1656 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:28.918448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903813d-c827-474c-a933-2e4b94c156ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:28.919305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903813d-c827-474c-a933-2e4b94c156ca None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:28.919850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903813d-c827-474c-a933-2e4b94c156ca None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:28.920121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903813d-c827-474c-a933-2e4b94c156ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:28.931930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903813d-c827-474c-a933-2e4b94c156ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:28.933418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903813d-c827-474c-a933-2e4b94c156ca None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-b903813d-c827-474c-a933-2e4b94c156ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:28.953934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:28.954905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:28.955836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:28.955836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:28.955836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:28.955836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:28.955836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 429/837] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:28.961306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:29.072680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a8189-34dc-4864-bdb9-aebb2f9130d5 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:29.081624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673ca22-ccbf-4ff5-bc4e-519e43b56893 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.081939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673ca22-ccbf-4ff5-bc4e-519e43b56893 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.082175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673ca22-ccbf-4ff5-bc4e-519e43b56893 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.083857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 430/838] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:29.088923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794eb5e-48c2-406b-a4f9-e98fee143554 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.089266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794eb5e-48c2-406b-a4f9-e98fee143554 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.089465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794eb5e-48c2-406b-a4f9-e98fee143554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.110931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7794eb5e-48c2-406b-a4f9-e98fee143554 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:29.112236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7794eb5e-48c2-406b-a4f9-e98fee143554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:29.117148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:29.118131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.118608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.119131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.120035 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:29.120943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:29.123485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:29.143119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 409/839] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:29.143898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:29.194209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 431/840] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:29.216524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794eb5e-48c2-406b-a4f9-e98fee143554 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:29.267902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04c06-8ee8-44dc-9faa-0b285b60af1c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:29.310228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:29.311076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.311379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.311661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.318840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:29.319800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794eb5e-48c2-406b-a4f9-e98fee143554 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:29.320386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:29.335852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:29.336837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:29.338154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 410/841] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:29.342524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:29.362097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:29.363293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.363783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.364254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.365130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:29.366694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:29.379388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:29.380414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:29.381247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:29.384140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 432/842] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:29.391016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:29.462272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45840c1-9293-467b-bda7-bebeb051e17c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:29.489945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09efc2-9c21-47ef-ae63-9ffd32db5571 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:29.498433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:29.499142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.499424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.499697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.500533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:29.500839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:29.502264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:29.519616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 411/843] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 16:32:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:29.523665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:29.524331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.524610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.524790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:29.524943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.525572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:29.525874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:29.527245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:29.536534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 433/844] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:29.537736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:29.624888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce39d3-9fce-4b7b-854c-8034d2e7aebd None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:29.636053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f73b-4c0c-4f46-86d8-a8ea1a9d1fde None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:29.658546 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65f0db-23bf-40f5-9a72-282dd5ef40db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:29.659205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65f0db-23bf-40f5-9a72-282dd5ef40db None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.659487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65f0db-23bf-40f5-9a72-282dd5ef40db None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.659764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65f0db-23bf-40f5-9a72-282dd5ef40db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.670051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:29.670712 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.671053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.671282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:29.671989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:29.672289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:29.673639 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:29.683434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 434/845] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:29.734197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65f0db-23bf-40f5-9a72-282dd5ef40db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:29.735635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65f0db-23bf-40f5-9a72-282dd5ef40db None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:29.843544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 412/846] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:32:29.852132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:29.955752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f936f-1897-4974-bfb8-2de41237040c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:29.989037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:29.989779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:29.990059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:29.990331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:30.002416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:30.003897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:30.021091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:30.023271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:30.025410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:30.025410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:30.025410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:30.025410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:30.025410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 435/847] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:30.028661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65f0db-23bf-40f5-9a72-282dd5ef40db None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:30.134274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65f0db-23bf-40f5-9a72-282dd5ef40db None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:30.168854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:30.169515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:30.170052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:30.170325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:30.171072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:30.171379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:30.172742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:30.184691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 413/848] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:30.190048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:30.289591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cf3fe-0308-4a19-86c3-c8408e39e360 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:30.326750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:30.327583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:30.327862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:30.328130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:30.334775 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:30.336234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:30.350789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:30.352823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:30.353999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 436/849] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:30.357649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:30.457162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47526c4a-ecbe-4bf9-bf68-b6b0d8afaaee None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:30.490568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859d616-1e26-4857-a235-982e7b08f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:30.491408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d616-1e26-4857-a235-982e7b08f2ad None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:30.491576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d616-1e26-4857-a235-982e7b08f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:30.491793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d616-1e26-4857-a235-982e7b08f2ad None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:30.492644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859d616-1e26-4857-a235-982e7b08f2ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:30.492954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859d616-1e26-4857-a235-982e7b08f2ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:30.494386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859d616-1e26-4857-a235-982e7b08f2ad None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:30.507346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 414/850] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:30.516015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:30.619368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a1430-e7c2-4358-9ca2-99eef3dbc56a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:30.653878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d915bb-bac8-4f1c-b75f-b11df150b1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:30.654538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d915bb-bac8-4f1c-b75f-b11df150b1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:30.654819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d915bb-bac8-4f1c-b75f-b11df150b1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:30.655134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d915bb-bac8-4f1c-b75f-b11df150b1d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:30.655963 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d915bb-bac8-4f1c-b75f-b11df150b1d1 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=5551a6e71bb0499d9161e6213acc0af9) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:30.656271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d915bb-bac8-4f1c-b75f-b11df150b1d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:30.657691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d915bb-bac8-4f1c-b75f-b11df150b1d1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:30.664491 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 437/851] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:30 2022] GET /identity/v3/role_assignments?user.id=5551a6e71bb0499d9161e6213acc0af9&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:31.141417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d26b7f-4382-4775-acfa-b0d09e59b5bf None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.141796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d26b7f-4382-4775-acfa-b0d09e59b5bf None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.141987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d26b7f-4382-4775-acfa-b0d09e59b5bf None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.143607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 415/852] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:31.148978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159d36-61ea-4ac2-b7fb-214e3cde2f83 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.149443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159d36-61ea-4ac2-b7fb-214e3cde2f83 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.149650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159d36-61ea-4ac2-b7fb-214e3cde2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.166298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-79159d36-61ea-4ac2-b7fb-214e3cde2f83 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:31.167512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-79159d36-61ea-4ac2-b7fb-214e3cde2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:31.210904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25aadf-25b7-4d1c-bfb0-a981ef31fd23 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.211235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25aadf-25b7-4d1c-bfb0-a981ef31fd23 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.211497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25aadf-25b7-4d1c-bfb0-a981ef31fd23 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.213106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 416/853] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:31.218780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288dc0a-744d-4c8d-a4b1-69638a52a762 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.219097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288dc0a-744d-4c8d-a4b1-69638a52a762 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.221323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288dc0a-744d-4c8d-a4b1-69638a52a762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.236257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 438/854] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:31.236817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-4288dc0a-744d-4c8d-a4b1-69638a52a762 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:31.237993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4288dc0a-744d-4c8d-a4b1-69638a52a762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:31.258825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159d36-61ea-4ac2-b7fb-214e3cde2f83 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:31.318984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 417/855] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:31.334675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288dc0a-744d-4c8d-a4b1-69638a52a762 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:31.364113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159d36-61ea-4ac2-b7fb-214e3cde2f83 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:31.405117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b49b5f-2864-47bc-9bdd-7b297cc7e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:31.406301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b49b5f-2864-47bc-9bdd-7b297cc7e473 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.407055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b49b5f-2864-47bc-9bdd-7b297cc7e473 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.407613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b49b5f-2864-47bc-9bdd-7b297cc7e473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.422425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b49b5f-2864-47bc-9bdd-7b297cc7e473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-40b49b5f-2864-47bc-9bdd-7b297cc7e473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:31.434860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:31.436229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:32:31.437082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:31.439870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 439/856] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:32:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:31.447017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b49b5f-2864-47bc-9bdd-7b297cc7e473 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:31.468778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288dc0a-744d-4c8d-a4b1-69638a52a762 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:31.503413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:31.504226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.504552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.504830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.505552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:31.507008 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:31.519531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:31.520526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:31.521357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 418/857] 10.222.0.57 () {56 vars in 1132 bytes} [Tue May 10 16:32:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:31.526571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:31.564657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b49b5f-2864-47bc-9bdd-7b297cc7e473 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:31.600417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:31.601087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.601373 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.601705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.602459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:31.602790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:31.604242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:31.616141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 440/858] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:32:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:31.621167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:31.650348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce10e9-740f-40a4-8d3c-0c79d6665025 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:31.693511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:31.694518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.695031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.695913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.696839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:31.697345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:31.699902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:31.707036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 419/859] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:31.713057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:31.724069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768977e-0e6e-4b6e-b4fc-b8f1a46ec7a1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:31.757796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:31.758626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.758911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.759231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.776009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:31.778178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:31.796611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:31.797542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:31.798437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:31.798437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:31.798437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:31.798437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:31.802395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 441/860] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:31.803511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:31.833617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8466a-db46-4a0e-980f-cf6847628cd0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:31.869627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:31.870622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.871156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.871614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.872649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:31.873153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:31.874769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:31.887339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 420/861] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:31.928990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef97f0-e4ce-4da1-9d2c-f32b03494700 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:31.967643 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1cf3f-aef8-4853-bbe6-9216a0a7c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:31.968567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1cf3f-aef8-4853-bbe6-9216a0a7c511 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:31.969018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1cf3f-aef8-4853-bbe6-9216a0a7c511 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:31.969480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1cf3f-aef8-4853-bbe6-9216a0a7c511 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:31.970385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1cf3f-aef8-4853-bbe6-9216a0a7c511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:31.970837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1cf3f-aef8-4853-bbe6-9216a0a7c511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:31.972545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1cf3f-aef8-4853-bbe6-9216a0a7c511 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:31.986493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 442/862] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:31.992536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:32.082249 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbad92-e8d8-4608-bf09-b3a15eb1212b None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:32.082595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbad92-e8d8-4608-bf09-b3a15eb1212b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:32.082786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbad92-e8d8-4608-bf09-b3a15eb1212b None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:32.084432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 443/863] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:32.091904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20a2d-ce6d-406d-b402-ffa70ed4982f None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:32.092184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20a2d-ce6d-406d-b402-ffa70ed4982f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:32.092461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20a2d-ce6d-406d-b402-ffa70ed4982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:32.109252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508fdca-ea30-4487-94f2-90c916ff798d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:32.113125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-add20a2d-ce6d-406d-b402-ffa70ed4982f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:32.114318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-add20a2d-ce6d-406d-b402-ffa70ed4982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:32.149633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:32.151480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:32.151985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:32.152529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:32.161415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:32.163567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:32.183003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:32.184520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:32.185468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:32.185996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 421/864] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:32:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:32.191383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:32.197306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 444/865] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:32.220358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add20a2d-ce6d-406d-b402-ffa70ed4982f None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:32.313897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d31a3-cd7d-40bf-aa96-43d7aaf2a7d6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:32.319930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add20a2d-ce6d-406d-b402-ffa70ed4982f None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:32.347828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:32.348688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:32.349064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:32.349524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:32.350474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:32.350879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:32.352616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:32.355493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fea86-fa56-4f92-b38f-0eff969b084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:32.356386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fea86-fa56-4f92-b38f-0eff969b084f None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:32.356846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fea86-fa56-4f92-b38f-0eff969b084f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:32.357300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fea86-fa56-4f92-b38f-0eff969b084f None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:32.358221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fea86-fa56-4f92-b38f-0eff969b084f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:32.359787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fea86-fa56-4f92-b38f-0eff969b084f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:32.376930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 422/866] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 16:32:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:32.378043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:32.387523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 445/867] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:32:32 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:32.493656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2f51c-ad15-441c-b6b6-f1a94f581a15 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:32.537327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790098c-5219-48a1-8c37-07bfacb304cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:32.537974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790098c-5219-48a1-8c37-07bfacb304cb None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:32.538256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790098c-5219-48a1-8c37-07bfacb304cb None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:32.538531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790098c-5219-48a1-8c37-07bfacb304cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:32.612136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790098c-5219-48a1-8c37-07bfacb304cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:32.613602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790098c-5219-48a1-8c37-07bfacb304cb None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:32.713615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 423/868] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:32 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:32:32.718987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fea86-fa56-4f92-b38f-0eff969b084f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:32.833950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fea86-fa56-4f92-b38f-0eff969b084f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:32.868837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b864ef-ff9b-46b1-94fb-40322e07ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:32.869928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b864ef-ff9b-46b1-94fb-40322e07ec26 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:32.870412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b864ef-ff9b-46b1-94fb-40322e07ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:32.870860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b864ef-ff9b-46b1-94fb-40322e07ec26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:32.881927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b864ef-ff9b-46b1-94fb-40322e07ec26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:32.883653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b864ef-ff9b-46b1-94fb-40322e07ec26 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-d4b864ef-ff9b-46b1-94fb-40322e07ec26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:32.904658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:32.905595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:32.906494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:32.906494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:32.906494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:32.906494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:32.906494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 446/869] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:32.912763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790098c-5219-48a1-8c37-07bfacb304cb None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:32.992694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb7000-d38e-4d99-98ab-749f369678af None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:32.993019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb7000-d38e-4d99-98ab-749f369678af None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:32.993246 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb7000-d38e-4d99-98ab-749f369678af None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:32.995143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 447/870] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:33.002280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4bb01-882b-4a36-9bae-53ee3205f3c3 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:33.002813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4bb01-882b-4a36-9bae-53ee3205f3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:33.003318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4bb01-882b-4a36-9bae-53ee3205f3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:33.017667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790098c-5219-48a1-8c37-07bfacb304cb None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:33.024064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-dae4bb01-882b-4a36-9bae-53ee3205f3c3 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:33.025931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-dae4bb01-882b-4a36-9bae-53ee3205f3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:33.057982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:33.058722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:33.059045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:33.059999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:33.061482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:33.061803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:33.068379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:33.086247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 424/871] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:33.094542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:33.113929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 448/872] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:33.135396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4bb01-882b-4a36-9bae-53ee3205f3c3 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:33.203960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbe97f-c5b0-4b57-a636-b412f6a441a4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:33.234918 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4bb01-882b-4a36-9bae-53ee3205f3c3 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:33.237487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:33.238285 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:33.238560 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:33.238832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:33.245766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:33.247301 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:33.262435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:33.263397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:33.264304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 425/873] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:33.270148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:33.275151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:33.275981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:33.276263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:33.276535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:33.277270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:33.279176 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:33.291553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:33.292653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:33.293546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 449/874] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:33.298764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:33.403607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eaa8a-81d9-47a8-98c3-1209ddab67e0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:33.419433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76140d42-6f49-4b97-9a6d-6fffcf0bf18f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:33.450354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:33.451262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:33.451691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:33.452136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:33.453067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:33.453511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:33.453886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:33.454642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:33.455044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:33.455420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:33.455782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:33.456322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:33.456727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:33.458166 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:33.463055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 450/875] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:33.468796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:33.474456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 426/876] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:33.479926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:33.571285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db4969-8dc2-453b-915e-30ecd3b3aed1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:33.590596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133aec5-5165-41b3-b94b-660ab6de842a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:33.609952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7d8c7-f7c5-44a3-aee7-589b10c61591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:33.611067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d8c7-f7c5-44a3-aee7-589b10c61591 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:33.611553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d8c7-f7c5-44a3-aee7-589b10c61591 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:33.612052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7d8c7-f7c5-44a3-aee7-589b10c61591 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:33.612952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7d8c7-f7c5-44a3-aee7-589b10c61591 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:33.613456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7d8c7-f7c5-44a3-aee7-589b10c61591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:33.615033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7d8c7-f7c5-44a3-aee7-589b10c61591 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:33.625614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60a50f-8017-4382-8a78-454d6dcd69f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:33.626020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 451/877] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:33.626126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60a50f-8017-4382-8a78-454d6dcd69f2 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:33.626318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60a50f-8017-4382-8a78-454d6dcd69f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:33.626590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60a50f-8017-4382-8a78-454d6dcd69f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:33.627508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60a50f-8017-4382-8a78-454d6dcd69f2 None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=09a9cf0f43624be493e7092f3a4a8f80) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:33.627825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60a50f-8017-4382-8a78-454d6dcd69f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:33.629348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60a50f-8017-4382-8a78-454d6dcd69f2 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:33.643123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 427/878] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:33 2022] GET /identity/v3/role_assignments?user.id=09a9cf0f43624be493e7092f3a4a8f80&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:34.204654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed56c8-4f55-4291-bca5-09fc6155f29c None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:34.205065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed56c8-4f55-4291-bca5-09fc6155f29c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:34.205259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed56c8-4f55-4291-bca5-09fc6155f29c None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:34.206808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 452/879] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:34.212184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef78c7-bc0a-4a06-b40b-455fb36f754f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:34.212472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef78c7-bc0a-4a06-b40b-455fb36f754f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:34.212748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef78c7-bc0a-4a06-b40b-455fb36f754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:34.236347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5eef78c7-bc0a-4a06-b40b-455fb36f754f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:34.237518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5eef78c7-bc0a-4a06-b40b-455fb36f754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:34.313970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 428/880] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:34.330938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed56c8-4f55-4291-bca5-09fc6155f29c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:34.434366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed56c8-4f55-4291-bca5-09fc6155f29c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:34.468456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5a13c-88ca-4154-b468-f681bb5343af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:34.469449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5a13c-88ca-4154-b468-f681bb5343af None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:34.469938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5a13c-88ca-4154-b468-f681bb5343af None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:34.470422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5a13c-88ca-4154-b468-f681bb5343af None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:34.471426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5a13c-88ca-4154-b468-f681bb5343af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:34.473025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5a13c-88ca-4154-b468-f681bb5343af None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:34.489887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 453/881] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:32:34 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:34.784007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb144da-de1a-48f0-a074-3c9a491d1380 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:34.785022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb144da-de1a-48f0-a074-3c9a491d1380 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:34.785548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb144da-de1a-48f0-a074-3c9a491d1380 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:34.787583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 429/882] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:34.793496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada9c8d-2d79-42ea-bd58-de4785cf05c5 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:34.793780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada9c8d-2d79-42ea-bd58-de4785cf05c5 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:34.794056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada9c8d-2d79-42ea-bd58-de4785cf05c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:34.812759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8ada9c8d-2d79-42ea-bd58-de4785cf05c5 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:34.814517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8ada9c8d-2d79-42ea-bd58-de4785cf05c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:34.890999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 454/883] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:34.911019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb144da-de1a-48f0-a074-3c9a491d1380 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:35.012451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb144da-de1a-48f0-a074-3c9a491d1380 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:35.047402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:35.048499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:35.048976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:35.049438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:35.050279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:35.051862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:35.064388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:35.065492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:35.066401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:35.068895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 430/884] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:35.074998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada9c8d-2d79-42ea-bd58-de4785cf05c5 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:35.171367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada9c8d-2d79-42ea-bd58-de4785cf05c5 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:35.210317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:35.210991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:35.211282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:35.211553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:35.212255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:35.212555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:35.213921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:35.219546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 455/885] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:35.224704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:35.326945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1ccb8-fcb0-4c72-9d86-30d38510f0c0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:35.361804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:35.362850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:35.363393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:35.363883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:35.364804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:35.365339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:35.366920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:35.372633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 431/886] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:35.378331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:35.477416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b66eb-ec8f-4577-9e4c-4bfd6721fe8b None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:35.513071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a1755-e630-4ffa-adc2-99673485b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:35.513724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1755-e630-4ffa-adc2-99673485b3ff None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:35.514000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1755-e630-4ffa-adc2-99673485b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:35.514262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1755-e630-4ffa-adc2-99673485b3ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:35.515076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a1755-e630-4ffa-adc2-99673485b3ff None admin] RBAC: Adding query filter params (interface=public, service_id=531f9d61d47d4cff984ce78e772b2377, region_id=RegionOne) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:35.515384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a1755-e630-4ffa-adc2-99673485b3ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:35.516735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a1755-e630-4ffa-adc2-99673485b3ff None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:35.522138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 456/887] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 16:32:35 2022] GET /identity/v3/endpoints?service_id=531f9d61d47d4cff984ce78e772b2377&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:35.527172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:35.627093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d19e-2c6f-4449-a7bd-3ab7063d2daa None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:35.661398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af0a0c-03b5-4d27-9a9c-10e6a1e6f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:35.662071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0a0c-03b5-4d27-9a9c-10e6a1e6f896 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:35.662352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0a0c-03b5-4d27-9a9c-10e6a1e6f896 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:35.662628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0a0c-03b5-4d27-9a9c-10e6a1e6f896 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:35.663344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af0a0c-03b5-4d27-9a9c-10e6a1e6f896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:35.664717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af0a0c-03b5-4d27-9a9c-10e6a1e6f896 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:35.671146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 432/888] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:32:35 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:32:35.934243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff385-7de1-4890-a6dc-3b5141a89273 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:35.934627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff385-7de1-4890-a6dc-3b5141a89273 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:35.934807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff385-7de1-4890-a6dc-3b5141a89273 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:35.936447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 457/889] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:35.941873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8108-0831-463c-ba92-0ea405ffe2bf None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:35.942317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8108-0831-463c-ba92-0ea405ffe2bf None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:35.942604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b8108-0831-463c-ba92-0ea405ffe2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:35.959223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-8e8b8108-0831-463c-ba92-0ea405ffe2bf None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:35.960401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8e8b8108-0831-463c-ba92-0ea405ffe2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:36.026442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 433/890] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:36.050243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff385-7de1-4890-a6dc-3b5141a89273 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:36.067352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7faad-f1e6-4ab1-ae4f-10400911e065 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.067668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7faad-f1e6-4ab1-ae4f-10400911e065 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.067909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7faad-f1e6-4ab1-ae4f-10400911e065 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.069525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 434/891] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:36.075783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa01c2-3879-4f22-af1e-0379ea691e98 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.076067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa01c2-3879-4f22-af1e-0379ea691e98 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.076345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa01c2-3879-4f22-af1e-0379ea691e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.092955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-88aa01c2-3879-4f22-af1e-0379ea691e98 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:36.094171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-88aa01c2-3879-4f22-af1e-0379ea691e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:36.155672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff385-7de1-4890-a6dc-3b5141a89273 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:36.160822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 435/892] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:36.186188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa01c2-3879-4f22-af1e-0379ea691e98 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:36.200244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabbaf-1c24-415f-923a-85a9a9061bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:36.201560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabbaf-1c24-415f-923a-85a9a9061bcb None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.202054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabbaf-1c24-415f-923a-85a9a9061bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.202669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabbaf-1c24-415f-923a-85a9a9061bcb None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.204008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cabbaf-1c24-415f-923a-85a9a9061bcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:36.205969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cabbaf-1c24-415f-923a-85a9a9061bcb None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:36.225383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 458/893] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:32:36 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:36.299921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa01c2-3879-4f22-af1e-0379ea691e98 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:36.345733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51da37f-430c-4e02-994a-63e387a4f2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:36.346557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da37f-430c-4e02-994a-63e387a4f2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.346834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da37f-430c-4e02-994a-63e387a4f2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.347172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da37f-430c-4e02-994a-63e387a4f2f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.359522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51da37f-430c-4e02-994a-63e387a4f2f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d51da37f-430c-4e02-994a-63e387a4f2f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:36.368038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:36.369056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:36.369895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 436/894] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 16:32:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:36.378100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabbaf-1c24-415f-923a-85a9a9061bcb None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:36.483461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabbaf-1c24-415f-923a-85a9a9061bcb None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:36.518339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:36.519479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.519976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.520470 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.521425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:36.521941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:36.523551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:36.532402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 459/895] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 16:32:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:36.538239 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51da37f-430c-4e02-994a-63e387a4f2f5 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:36.636825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51da37f-430c-4e02-994a-63e387a4f2f5 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:36.674772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a672-5ca7-4012-a255-a00713eedb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:36.675978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a672-5ca7-4012-a255-a00713eedb30 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.676475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a672-5ca7-4012-a255-a00713eedb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.676967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a672-5ca7-4012-a255-a00713eedb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.687985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21a672-5ca7-4012-a255-a00713eedb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:36.689679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21a672-5ca7-4012-a255-a00713eedb30 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-cb21a672-5ca7-4012-a255-a00713eedb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:36.709349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:36.710281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:36.711211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:36.711211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:36.711211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:36.711211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:36.713459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 437/896] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:36.719699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:36.821696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a539-46c9-4607-8e76-4761ab179310 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:36.829268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9befd-4f10-454e-8fb0-64a1838c669a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.829557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9befd-4f10-454e-8fb0-64a1838c669a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.829823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9befd-4f10-454e-8fb0-64a1838c669a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.831450 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 438/897] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:36.842085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d998-ed8e-49d3-bc8d-d41f06ce4246 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.842687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d998-ed8e-49d3-bc8d-d41f06ce4246 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.843199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d998-ed8e-49d3-bc8d-d41f06ce4246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.863898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6a65d998-ed8e-49d3-bc8d-d41f06ce4246 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:36.864087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:36.864717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:36.864999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:36.865274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:36.866001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:36.866305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:36.866613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6a65d998-ed8e-49d3-bc8d-d41f06ce4246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:36.867693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:36.881970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 460/898] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:36.887481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:36.959028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 439/899] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:36.975461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d998-ed8e-49d3-bc8d-d41f06ce4246 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.010256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ddaee-5c85-4a3d-917f-52e29965661e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.053777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.054688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.055069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.055412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.065428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.066873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.081220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d998-ed8e-49d3-bc8d-d41f06ce4246 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:37.086051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:37.087048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:37.088100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 461/900] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:32:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:37.093637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.126605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.128668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.129219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.129693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.130587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.132221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:37.148717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:37.149867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:37.150908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:37.154748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 440/901] 10.222.0.57 () {56 vars in 1132 bytes} [Tue May 10 16:32:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:37.163843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.200704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319447-5d24-47db-98d4-34b04a33b4a2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.236074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.236733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.237011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.237284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.238116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:37.238422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.239873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.261063 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 462/902] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:37.262461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.284585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcade8a-2f2b-497f-9561-4ab894d2e8f9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.327789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.329704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.330191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.330663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.331676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:37.332192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.334179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.346380 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 441/903] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:37.348684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.364507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5d5-02f4-46f1-9b9c-25ab20e336a6 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.403715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee893-23c0-4d7e-b4ad-82f5509a91d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.405113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee893-23c0-4d7e-b4ad-82f5509a91d2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.405649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee893-23c0-4d7e-b4ad-82f5509a91d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.406444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee893-23c0-4d7e-b4ad-82f5509a91d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.462927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39bc2-1ff0-4513-8fa7-ea038629a385 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.492546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ee893-23c0-4d7e-b4ad-82f5509a91d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.495205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ee893-23c0-4d7e-b4ad-82f5509a91d2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.497484 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.498357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.498868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.499402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.500331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:37.500839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.502405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.507971 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 442/904] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:37.513778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.602771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 463/905] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:32:37.614480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee893-23c0-4d7e-b4ad-82f5509a91d2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.614664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d242d-2b6c-439e-a146-1a0cde662289 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.648425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.649564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.650050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.650512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.651331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] RBAC: Adding query filter params (interface=public, service_id=4f28993ab16f409d9e1937aace19697f, region_id=RegionOne) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:37.651782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.653962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.659165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 443/906] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/endpoints?service_id=4f28993ab16f409d9e1937aace19697f&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:37.664569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.726502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee893-23c0-4d7e-b4ad-82f5509a91d2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.767305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.768631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.768978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.769314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.780887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354a23-d65c-4f64-a001-faf534a89841 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.782706 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.784994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:37.806759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:37.807912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:37.809064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:37.809064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:37.809064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:37.809064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:37.814436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 464/907] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:37.815815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:37.822224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee3bae-6154-451b-9f57-239bcd562e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.823226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3bae-6154-451b-9f57-239bcd562e03 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.823708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3bae-6154-451b-9f57-239bcd562e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.824739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee3bae-6154-451b-9f57-239bcd562e03 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.825627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee3bae-6154-451b-9f57-239bcd562e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.827283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee3bae-6154-451b-9f57-239bcd562e03 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.839137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 444/908] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:32:37.930637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7ac4f-7584-4f6c-8681-e3dd4b75fb3c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:37.967753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcaa29-06a9-4cba-924f-519b699d9131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:37.968430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcaa29-06a9-4cba-924f-519b699d9131 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:37.968707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcaa29-06a9-4cba-924f-519b699d9131 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:37.968976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcaa29-06a9-4cba-924f-519b699d9131 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:37.969704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcaa29-06a9-4cba-924f-519b699d9131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:37.970006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcaa29-06a9-4cba-924f-519b699d9131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:37.971406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcaa29-06a9-4cba-924f-519b699d9131 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:37.988582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 465/909] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:37.989962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee3bae-6154-451b-9f57-239bcd562e03 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.086814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e0f9-2e4c-4d99-8268-8f28bd9abc98 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.087133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e0f9-2e4c-4d99-8268-8f28bd9abc98 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.087417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e0f9-2e4c-4d99-8268-8f28bd9abc98 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.089024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 466/910] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:38.094618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728563-b683-4193-b90e-8fd0e87d1843 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.094907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728563-b683-4193-b90e-8fd0e87d1843 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.095238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728563-b683-4193-b90e-8fd0e87d1843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.095606 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee3bae-6154-451b-9f57-239bcd562e03 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:38.111850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3a728563-b683-4193-b90e-8fd0e87d1843 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:38.113028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3a728563-b683-4193-b90e-8fd0e87d1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:38.135431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:38.136296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.137145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.137742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.146830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:38.148302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:38.164444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:38.165390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:38.171629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 445/911] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:38.174119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.195988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 467/912] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:38.219444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a728563-b683-4193-b90e-8fd0e87d1843 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.284480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7900d-9eab-4c4c-bec5-b273a82f3266 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:38.318701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:38.319485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.319770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.320251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.320832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:38.321141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:38.322563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:38.338736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 446/913] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:38.341565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.342668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a728563-b683-4193-b90e-8fd0e87d1843 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:38.382814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:38.383679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.383960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.384231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.385041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:38.386281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:38.399576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:38.400606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:38.402043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 468/914] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:38.407575 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.472954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c3cd3-5f95-4826-9762-fd45f42b181b None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:38.509459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549835bf-2a5d-4fe4-b810-2575c3d17897 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:38.517665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793c3eb-a16f-4f9f-81b4-6e8c257f5d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:38.519001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c3eb-a16f-4f9f-81b4-6e8c257f5d1a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.519507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c3eb-a16f-4f9f-81b4-6e8c257f5d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.520296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c3eb-a16f-4f9f-81b4-6e8c257f5d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.521603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793c3eb-a16f-4f9f-81b4-6e8c257f5d1a None admin] RBAC: Adding query filter params (role.id=958301c56fca46b5bc19e26c4d062373, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=09a9cf0f43624be493e7092f3a4a8f80) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:38.522115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793c3eb-a16f-4f9f-81b4-6e8c257f5d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:38.524495 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793c3eb-a16f-4f9f-81b4-6e8c257f5d1a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:38.539507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 447/915] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:38 2022] GET /identity/v3/role_assignments?user.id=09a9cf0f43624be493e7092f3a4a8f80&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=958301c56fca46b5bc19e26c4d062373 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:38.548828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc06ac-af16-4c45-98e8-348fe0a68c62 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.549150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc06ac-af16-4c45-98e8-348fe0a68c62 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.549402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc06ac-af16-4c45-98e8-348fe0a68c62 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.551003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 448/916] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:38.557453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a594a7-fc78-459c-9421-254b199852b7 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.557769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a594a7-fc78-459c-9421-254b199852b7 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.558015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a594a7-fc78-459c-9421-254b199852b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.561441 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:38.562558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.563128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.563678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.564423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:38.564734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:38.566129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:38.571975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 469/917] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:38.577734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-58a594a7-fc78-459c-9421-254b199852b7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:38.577923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.579424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-58a594a7-fc78-459c-9421-254b199852b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:38.664605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 449/918] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:38.689478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a594a7-fc78-459c-9421-254b199852b7 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.692690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f5c0-500f-4ddf-b8c3-31b8869420b7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:38.735804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:38.736476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.736753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.738501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.738501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:38.738501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:38.739411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:38.744948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 470/919] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 16:32:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:38.751105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.809735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a594a7-fc78-459c-9421-254b199852b7 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:38.844077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:38.844883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.845157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.845428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.846146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:38.847480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:38.860457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:38.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:38.862367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 450/920] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:38.867491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:38.872796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb30f-f3d0-45de-bc4a-e62aa3b4bec5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:38.913845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba825-5cf2-4615-ad99-88ddae8fe1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:38.914494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba825-5cf2-4615-ad99-88ddae8fe1c7 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:38.914827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba825-5cf2-4615-ad99-88ddae8fe1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:38.915070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba825-5cf2-4615-ad99-88ddae8fe1c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:38.915800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ba825-5cf2-4615-ad99-88ddae8fe1c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:38.917161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ba825-5cf2-4615-ad99-88ddae8fe1c7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:38.941406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 471/921] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:32:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:39.004041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a549d4-082a-49b3-838e-d1afe0096a8c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:39.052587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:39.053347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:39.053629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:39.053897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:39.054610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:39.054910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:39.056379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:39.062378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 451/922] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:39.068765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba825-5cf2-4615-ad99-88ddae8fe1c7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:39.181751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba825-5cf2-4615-ad99-88ddae8fe1c7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:39.216650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:39.217317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:39.217593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:39.217862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:39.218563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:39.218913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:39.220290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:39.225345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 472/923] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:39.231147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:39.333701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a336d-093b-415e-9ee5-2b5d9c793f78 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:39.368099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401819ca-3cd5-47e2-8def-5fb50028cdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:39.368750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401819ca-3cd5-47e2-8def-5fb50028cdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:39.369139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401819ca-3cd5-47e2-8def-5fb50028cdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:39.369417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401819ca-3cd5-47e2-8def-5fb50028cdb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:39.370266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401819ca-3cd5-47e2-8def-5fb50028cdb3 None admin] RBAC: Adding query filter params (interface=public, service_id=709258df5c414a759b66805a70723b7b, region_id=RegionOne) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:39.370578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401819ca-3cd5-47e2-8def-5fb50028cdb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:39.372036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401819ca-3cd5-47e2-8def-5fb50028cdb3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:39.377532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 452/924] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 16:32:39 2022] GET /identity/v3/endpoints?service_id=709258df5c414a759b66805a70723b7b&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:39.384048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:39.483759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b27f8-23b4-4e2e-af47-e092e5129478 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:39.521665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd543b5a-f169-41cd-b2da-7de70a7a89f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:39.522333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543b5a-f169-41cd-b2da-7de70a7a89f3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:39.522596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543b5a-f169-41cd-b2da-7de70a7a89f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:39.522873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543b5a-f169-41cd-b2da-7de70a7a89f3 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:39.523584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd543b5a-f169-41cd-b2da-7de70a7a89f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:39.524936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd543b5a-f169-41cd-b2da-7de70a7a89f3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:39.531722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 473/925] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:32:39 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:32:40.150762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240dc4-2352-40d2-9a26-f18bfcab8a28 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:40.151336 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240dc4-2352-40d2-9a26-f18bfcab8a28 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:40.151336 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240dc4-2352-40d2-9a26-f18bfcab8a28 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:40.153135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 453/926] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:40.159157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f3ec-2814-462f-8d27-bb5617b561d2 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:40.159451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f3ec-2814-462f-8d27-bb5617b561d2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:40.159734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f3ec-2814-462f-8d27-bb5617b561d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:40.177171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-43a4f3ec-2814-462f-8d27-bb5617b561d2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:40.178342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-43a4f3ec-2814-462f-8d27-bb5617b561d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:40.244163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 474/927] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:40.266995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240dc4-2352-40d2-9a26-f18bfcab8a28 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:40.368437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240dc4-2352-40d2-9a26-f18bfcab8a28 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:40.407266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:40.408051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:40.408333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:40.408600 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:40.409246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:40.410608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:40.423995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:40.424957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:40.425807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 454/928] 10.222.0.57 () {56 vars in 1132 bytes} [Tue May 10 16:32:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:40.431278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4f3ec-2814-462f-8d27-bb5617b561d2 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:40.525562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4f3ec-2814-462f-8d27-bb5617b561d2 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:40.558956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:40.559636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:40.559916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:40.560194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:40.560896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:40.561199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:40.562657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:40.567571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 475/929] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:40.573229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:40.674759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee513f-b146-4f6e-a9cb-35600d19e576 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:40.714105 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37201a-6911-446d-a9ae-6842585da879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:40.715436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37201a-6911-446d-a9ae-6842585da879 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:40.715716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37201a-6911-446d-a9ae-6842585da879 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:40.715981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37201a-6911-446d-a9ae-6842585da879 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:40.716710 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37201a-6911-446d-a9ae-6842585da879 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:40.717014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37201a-6911-446d-a9ae-6842585da879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:40.718485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37201a-6911-446d-a9ae-6842585da879 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:40.724432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 455/930] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:40.729675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:40.834002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed19db-326b-45c8-8f85-1cb90306fad0 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:40.874788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e597c8-9cab-463a-9674-d6c3f46988bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:40.875912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e597c8-9cab-463a-9674-d6c3f46988bd None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:40.876457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e597c8-9cab-463a-9674-d6c3f46988bd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:40.876936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e597c8-9cab-463a-9674-d6c3f46988bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:40.877919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e597c8-9cab-463a-9674-d6c3f46988bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:40.879997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e597c8-9cab-463a-9674-d6c3f46988bd None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:40.896248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a47f-d49e-4d28-99b0-14d29e9e4a13 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:40.896534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a47f-d49e-4d28-99b0-14d29e9e4a13 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:40.896806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a47f-d49e-4d28-99b0-14d29e9e4a13 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:40.902796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 456/931] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:40.904468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b80d-2449-4122-af95-c6df28551b3f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:40.904814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b80d-2449-4122-af95-c6df28551b3f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:40.905179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b80d-2449-4122-af95-c6df28551b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:40.907115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 476/932] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:32:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:40.923863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1c46b80d-2449-4122-af95-c6df28551b3f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:40.925227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1c46b80d-2449-4122-af95-c6df28551b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:41.010642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 457/933] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:41.028881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e597c8-9cab-463a-9674-d6c3f46988bd None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:41.132980 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e597c8-9cab-463a-9674-d6c3f46988bd None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:41.170667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced0cd7-efda-4c63-9c77-154adc29adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:41.171961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0cd7-efda-4c63-9c77-154adc29adbf None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.172454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0cd7-efda-4c63-9c77-154adc29adbf None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.172955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0cd7-efda-4c63-9c77-154adc29adbf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.185772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced0cd7-efda-4c63-9c77-154adc29adbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-6ced0cd7-efda-4c63-9c77-154adc29adbf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:41.194787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:41.195815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:41.196697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.200073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 477/934] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 16:32:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:41.208310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b80d-2449-4122-af95-c6df28551b3f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:41.306206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b80d-2449-4122-af95-c6df28551b3f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:41.340780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:41.341446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.341722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.341993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.342736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:41.343062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:41.344426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:41.346648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd526-1620-44a2-bbe9-6ad49fa2540d None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.347083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd526-1620-44a2-bbe9-6ad49fa2540d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.347465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd526-1620-44a2-bbe9-6ad49fa2540d None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.349296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 478/935] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:41.356320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b550ac-8c79-473e-9d23-abfcf3c23e7f None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.356609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b550ac-8c79-473e-9d23-abfcf3c23e7f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.356883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b550ac-8c79-473e-9d23-abfcf3c23e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.359052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 458/936] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 16:32:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:41.362747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:41.379700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a1b550ac-8c79-473e-9d23-abfcf3c23e7f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:41.381112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a1b550ac-8c79-473e-9d23-abfcf3c23e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:41.455827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 479/937] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:41.469641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476be02-2107-48de-b105-ef7e58df9449 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:41.479032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b550ac-8c79-473e-9d23-abfcf3c23e7f None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:41.512029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:41.512827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.513110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.513380 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.524288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:41.525747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:41.543623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:41.544989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:41.545947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:41.545947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:41.545947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:41.545947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:41.545947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 459/938] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:41.551420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:41.586683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b550ac-8c79-473e-9d23-abfcf3c23e7f None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:41.621683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:41.622784 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.623276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.623712 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.624478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:41.628344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:41.630075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING keystone.server.flask.common [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 16:32:41.649758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.sql.core [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 16:32:41.649758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 16:32:41.649758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [parameters: {'id': '55dcdb82848e48929ed64d9719bc8896', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 16:32:41.649758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81322) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55dcdb82848e48929ed64d9719bc8896.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55dcdb82848e48929ed64d9719bc8896. May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application conn.query(q) May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:32:41.659972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result.read() May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 16:32:41.661579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application next(self.gen) May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application yield resource May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application next(self.gen) May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.session.rollback() May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.force_reraise() May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise self.value May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application session.commit() May 10 16:32:41.662871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._prepare_impl() May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.session.flush() May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._flush(objects) May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application compat.raise_( May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application flush_context.execute() May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 16:32:41.664552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rec.execute(self) May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 16:32:41.665755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application conn.query(q) May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result.read() May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:32:41.666733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [parameters: {'id': '55dcdb82848e48929ed64d9719bc8896', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:41.673938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:41.675944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55dcdb82848e48929ed64d9719bc8896. May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 480/939] 10.222.0.57 () {60 vars in 1140 bytes} [Tue May 10 16:32:41 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:41.678225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:41.679690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c2872-5a6d-4978-a842-d671e97cf96c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:41.720074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:41.721066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.721555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.722033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.723002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:41.723515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:41.725084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:41.738131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 460/940] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:41.745872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:41.803288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c1b1d-5f44-4beb-9978-ff6df184f21c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:41.842068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259aac2-1204-44e2-b3a9-0895bf44f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:41.843516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259aac2-1204-44e2-b3a9-0895bf44f980 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.844025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259aac2-1204-44e2-b3a9-0895bf44f980 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.844505 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259aac2-1204-44e2-b3a9-0895bf44f980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.846123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6340c0-41db-470f-9e72-8981afbbc503 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:41.852760 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259aac2-1204-44e2-b3a9-0895bf44f980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:41.856015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259aac2-1204-44e2-b3a9-0895bf44f980 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-d259aac2-1204-44e2-b3a9-0895bf44f980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:41.871184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:41.872125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:41.873032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 481/941] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:41.876871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5baa45-c1e8-4acf-908a-54658af4a1af None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.876871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5baa45-c1e8-4acf-908a-54658af4a1af None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.877076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5baa45-c1e8-4acf-908a-54658af4a1af None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.882318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 482/942] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:41.882318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5baa45-c1e8-4acf-908a-54658af4a1af None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:41.888690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337715c-835e-4f4f-93cb-044eda801817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:41.889522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337715c-835e-4f4f-93cb-044eda801817 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.889797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337715c-835e-4f4f-93cb-044eda801817 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.890062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337715c-835e-4f4f-93cb-044eda801817 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.898451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337715c-835e-4f4f-93cb-044eda801817 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:41.899918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337715c-835e-4f4f-93cb-044eda801817 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-e337715c-835e-4f4f-93cb-044eda801817 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:41.916032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:41.916960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:41.918567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:41.922658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 461/943] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:32:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:41.923826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da31ca-db21-43e9-a604-8da056f74a41 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:41.924108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da31ca-db21-43e9-a604-8da056f74a41 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:41.924382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da31ca-db21-43e9-a604-8da056f74a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:41.940973 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-30da31ca-db21-43e9-a604-8da056f74a41 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:41.942140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-30da31ca-db21-43e9-a604-8da056f74a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:41.989553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5baa45-c1e8-4acf-908a-54658af4a1af None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.006472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 462/944] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:42.011998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da31ca-db21-43e9-a604-8da056f74a41 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.029730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.030392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.030670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.031293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.031721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:42.032025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.033446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.051636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 483/945] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:42.052519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.151401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da31ca-db21-43e9-a604-8da056f74a41 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.163902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1999d-dc2c-441f-8c45-313f81b86e8a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.189612 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.190602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.191158 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.191766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.192850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:42.193316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.195146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.202122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.202941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.203273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.203507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.204170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.205538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:42.220773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:42.222148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:42.223044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 484/946] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:42.223856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 463/947] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 16:32:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:42.225784 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.227159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.343014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d43767-b424-47c0-a10d-46ebfc30e7f2 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.365600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d60c-663d-40e4-a010-4a86f11caf9a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.388382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.389379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.389910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.390208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.391112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:42.391427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.393370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.398996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.399610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 464/948] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:42.399924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.400286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.400681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.405618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.413323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.414835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:42.432964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:42.434448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:42.435552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:42.435552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:42.435552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:42.435552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:42.435552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 485/949] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:42.441214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.508080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbae5ae-41b5-4c9d-836c-bec345b70f4c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.541502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.542405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.543494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446acaf-7d80-431e-8354-627c095543d7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.543770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.544196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.545292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:42.545779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.547356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.552881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 465/950] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:42.558946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.587024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.587694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.587971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.588478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.589205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:42.590034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.591898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.611161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 486/951] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:42.614316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.682039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726437fc-fda1-4cea-a3bb-69e2bb594f79 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.715880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14ee5-1cca-4777-94b0-7011e0df44d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.716549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14ee5-1cca-4777-94b0-7011e0df44d4 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.716849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14ee5-1cca-4777-94b0-7011e0df44d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.717127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14ee5-1cca-4777-94b0-7011e0df44d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.717858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c14ee5-1cca-4777-94b0-7011e0df44d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.719273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c14ee5-1cca-4777-94b0-7011e0df44d4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.737973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54786b27-cd78-4493-a35d-41b500ebe1d0 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.747161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 466/952] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:32:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:42.783748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.784938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.785459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.785995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.795253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.797203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:42.812913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:42.814326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:42.815244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:42.815244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:42.815244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:42.815244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:42.815244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:42.815244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:42.815244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:42.815244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:42.822572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 487/953] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:42.824618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14ee5-1cca-4777-94b0-7011e0df44d4 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:42.940493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14ee5-1cca-4777-94b0-7011e0df44d4 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:42.976275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5cacb-4a27-4c6f-9adc-1d835800cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:42.977290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cacb-4a27-4c6f-9adc-1d835800cb94 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:42.977767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cacb-4a27-4c6f-9adc-1d835800cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:42.978262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5cacb-4a27-4c6f-9adc-1d835800cb94 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:42.979328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5cacb-4a27-4c6f-9adc-1d835800cb94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:42.979851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5cacb-4a27-4c6f-9adc-1d835800cb94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:42.981604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5cacb-4a27-4c6f-9adc-1d835800cb94 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:42.997562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 467/954] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:43.001062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:43.105603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae9d35-68b8-4ce5-96a9-cb47c7f17207 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:43.139467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa409e0-c526-4ca4-9e97-c1a6ea80ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:43.140368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa409e0-c526-4ca4-9e97-c1a6ea80ec1e None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:43.140651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa409e0-c526-4ca4-9e97-c1a6ea80ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:43.140926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa409e0-c526-4ca4-9e97-c1a6ea80ec1e None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/09a9cf0f43624be493e7092f3a4a8f80/roles/958301c56fca46b5bc19e26c4d062373` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:43.143285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa409e0-c526-4ca4-9e97-c1a6ea80ec1e None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=09a9cf0f43624be493e7092f3a4a8f80, role_id=958301c56fca46b5bc19e26c4d062373)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:43.144703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa409e0-c526-4ca4-9e97-c1a6ea80ec1e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:43.159719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 488/955] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:32:43 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/09a9cf0f43624be493e7092f3a4a8f80/roles/958301c56fca46b5bc19e26c4d062373 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:32:43.254899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db97b-942f-48a1-ae02-b2b5ffb6fe13 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:43.255444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db97b-942f-48a1-ae02-b2b5ffb6fe13 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:43.255558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184db97b-942f-48a1-ae02-b2b5ffb6fe13 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:43.257225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 468/956] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:43.263499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b84f3-05d5-407f-99b4-42651c1b1c5c None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:43.263798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b84f3-05d5-407f-99b4-42651c1b1c5c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:43.264064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b84f3-05d5-407f-99b4-42651c1b1c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:43.282700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-eb4b84f3-05d5-407f-99b4-42651c1b1c5c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:43.284300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-eb4b84f3-05d5-407f-99b4-42651c1b1c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:43.360615 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 489/957] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:43.382749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184db97b-942f-48a1-ae02-b2b5ffb6fe13 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:43.486293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184db97b-942f-48a1-ae02-b2b5ffb6fe13 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:43.519935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:43.520728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:43.521003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:43.521273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:43.521915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:43.523307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:43.535282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:43.536283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:43.538233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 469/958] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:43.542400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b84f3-05d5-407f-99b4-42651c1b1c5c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:43.645613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b84f3-05d5-407f-99b4-42651c1b1c5c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:43.680299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c950-8f52-4436-9bff-b4991734bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:43.681209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c950-8f52-4436-9bff-b4991734bb3a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:43.681640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c950-8f52-4436-9bff-b4991734bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:43.682096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c950-8f52-4436-9bff-b4991734bb3a None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:43.682951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c950-8f52-4436-9bff-b4991734bb3a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:43.683961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c950-8f52-4436-9bff-b4991734bb3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:43.685478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c950-8f52-4436-9bff-b4991734bb3a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:43.691117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 490/959] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:43.699517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:43.799739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f531db-1c65-4e5a-8006-af9de63f64dd None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:43.832863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ac7f3-4e1a-449a-925b-5b9199940bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:43.833523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac7f3-4e1a-449a-925b-5b9199940bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:43.833803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac7f3-4e1a-449a-925b-5b9199940bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:43.834077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac7f3-4e1a-449a-925b-5b9199940bd9 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:43.834849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ac7f3-4e1a-449a-925b-5b9199940bd9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:43.835188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ac7f3-4e1a-449a-925b-5b9199940bd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:43.836578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ac7f3-4e1a-449a-925b-5b9199940bd9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:43.841596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 470/960] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:44.453711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e195b-1bf7-4954-96fa-76fbc69efb5f None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:44.453988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e195b-1bf7-4954-96fa-76fbc69efb5f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:44.454262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e195b-1bf7-4954-96fa-76fbc69efb5f None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:44.455897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 491/961] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:44.461749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fbe68-ef33-49f4-9fa9-7b9571e828b2 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:44.462221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fbe68-ef33-49f4-9fa9-7b9571e828b2 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:44.462336 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fbe68-ef33-49f4-9fa9-7b9571e828b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:44.479392 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ce6fbe68-ef33-49f4-9fa9-7b9571e828b2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:44.480589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ce6fbe68-ef33-49f4-9fa9-7b9571e828b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:44.549869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 471/962] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:44.573560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e195b-1bf7-4954-96fa-76fbc69efb5f None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:44.673366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e195b-1bf7-4954-96fa-76fbc69efb5f None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:44.706578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:44.707192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:44.707471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:44.707742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:44.708496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:44.709907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:44.726366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.sql.core [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 16:32:44.726366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 16:32:44.726366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [parameters: {'user_id': '900b83c68e2a44ae9a4ba1e56a6912f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 16:32:44.726366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81322) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application conn.query(q) May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result.read() May 10 16:32:44.734071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:32:44.735154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application next(self.gen) May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application yield resource May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application next(self.gen) May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.session.rollback() May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.force_reraise() May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise self.value May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application session.commit() May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 16:32:44.736391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._prepare_impl() May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.session.flush() May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._flush(objects) May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application compat.raise_( May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application flush_context.execute() May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rec.execute(self) May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 16:32:44.737513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:32:44.738395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application conn.query(q) May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application result.read() May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:32:44.739262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [parameters: {'user_id': '900b83c68e2a44ae9a4ba1e56a6912f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:44.743325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 16:32:44.745241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 16:32:44.747492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 16:32:44.747492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 16:32:44.747492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 16:32:44.747492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 16:32:44.747492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 16:32:44.747492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:44.747492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 492/963] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 16:32:44 2022] POST /identity/v3/users => generated 160 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:44.748390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fbe68-ef33-49f4-9fa9-7b9571e828b2 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:44.842123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fbe68-ef33-49f4-9fa9-7b9571e828b2 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:44.875824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab6300-83a8-4197-a1c4-238c5bf13ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:44.876626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab6300-83a8-4197-a1c4-238c5bf13ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:44.876911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab6300-83a8-4197-a1c4-238c5bf13ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:44.877188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab6300-83a8-4197-a1c4-238c5bf13ed4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:44.885001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab6300-83a8-4197-a1c4-238c5bf13ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:44.885941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab6300-83a8-4197-a1c4-238c5bf13ed4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-9eab6300-83a8-4197-a1c4-238c5bf13ed4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:44.901019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:44.903421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:44.905072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 472/964] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:44.908657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.017634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a3ce-ecfc-4653-9f7b-44f06a524f4a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:45.055049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d6864-e878-49a4-8e3b-7ec23f41bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:45.055720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d6864-e878-49a4-8e3b-7ec23f41bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.056163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d6864-e878-49a4-8e3b-7ec23f41bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.056444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d6864-e878-49a4-8e3b-7ec23f41bbf2 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.057253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d6864-e878-49a4-8e3b-7ec23f41bbf2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:45.057553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d6864-e878-49a4-8e3b-7ec23f41bbf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:45.059854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d6864-e878-49a4-8e3b-7ec23f41bbf2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:45.098550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 493/965] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 16:32:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:45.133266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef43ad-308f-4251-b92a-ee96ec020bd8 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.133606 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef43ad-308f-4251-b92a-ee96ec020bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.133813 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef43ad-308f-4251-b92a-ee96ec020bd8 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.135641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 473/966] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:45.142192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff9aa-a2fd-4147-9edb-679110618d6a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.142523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff9aa-a2fd-4147-9edb-679110618d6a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.142762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff9aa-a2fd-4147-9edb-679110618d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.160887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a35ff9aa-a2fd-4147-9edb-679110618d6a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:45.162490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a35ff9aa-a2fd-4147-9edb-679110618d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:45.238062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 494/967] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:45.261401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef43ad-308f-4251-b92a-ee96ec020bd8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.368758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef43ad-308f-4251-b92a-ee96ec020bd8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:45.406074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99897-da13-4c83-aa6a-278eb3a5680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:45.406884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99897-da13-4c83-aa6a-278eb3a5680e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.407246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99897-da13-4c83-aa6a-278eb3a5680e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.407577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99897-da13-4c83-aa6a-278eb3a5680e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.408237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99897-da13-4c83-aa6a-278eb3a5680e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:45.409605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99897-da13-4c83-aa6a-278eb3a5680e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-fcd99897-da13-4c83-aa6a-278eb3a5680e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:45.422772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:45.423824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:45.424656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 474/968] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:45.430207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff9aa-a2fd-4147-9edb-679110618d6a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.531979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff9aa-a2fd-4147-9edb-679110618d6a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:45.543733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbb94b-5124-4e20-9d93-8db8f42a8531 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.544227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbb94b-5124-4e20-9d93-8db8f42a8531 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.544345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbb94b-5124-4e20-9d93-8db8f42a8531 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.546034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 475/969] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:45.551133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c4d9e-2842-41a0-9767-ee227e17c389 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.551418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c4d9e-2842-41a0-9767-ee227e17c389 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.551693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c4d9e-2842-41a0-9767-ee227e17c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.566825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:45.567524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.567807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.568084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.568181 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-b19c4d9e-2842-41a0-9767-ee227e17c389 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:45.568792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:45.569105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:45.569338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b19c4d9e-2842-41a0-9767-ee227e17c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:45.570468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:45.576002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 495/970] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:45.581296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.643106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 476/971] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:45.660624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c4d9e-2842-41a0-9767-ee227e17c389 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.686458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd255a7f-5466-4537-b733-0fa0b99a9303 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:45.719374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:45.720039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.720319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.720594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.721296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:45.721603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:45.722983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:45.732805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 496/972] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:45.733846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.758035 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c4d9e-2842-41a0-9767-ee227e17c389 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:45.791874 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055b12a-dee7-44f7-b4b4-e6ca5de59500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:45.792730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b12a-dee7-44f7-b4b4-e6ca5de59500 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.793007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b12a-dee7-44f7-b4b4-e6ca5de59500 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.793280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055b12a-dee7-44f7-b4b4-e6ca5de59500 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.803433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055b12a-dee7-44f7-b4b4-e6ca5de59500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d055b12a-dee7-44f7-b4b4-e6ca5de59500 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:45.812275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:45.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 477/973] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 16:32:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:45.819182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055b12a-dee7-44f7-b4b4-e6ca5de59500 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.838539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a28858-28a5-41ea-8c21-e3362239438e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:45.871909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:45.872561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.876081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.876081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.876081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] RBAC: Adding query filter params (interface=admin, service_id=709258df5c414a759b66805a70723b7b, region_id=RegionOne) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:45.876081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:45.876081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:45.884225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 497/974] 10.222.0.57 () {56 vars in 1249 bytes} [Tue May 10 16:32:45 2022] GET /identity/v3/endpoints?service_id=709258df5c414a759b66805a70723b7b&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:45.890019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.924974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055b12a-dee7-44f7-b4b4-e6ca5de59500 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:45.957931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:45.958589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:45.958869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:45.959185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:45.959933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:45.960236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:45.961622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:45.974643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 478/975] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 16:32:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:45.976084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:45.987446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6754a4-95dc-4c06-a3b0-1ec8f5269eb4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:46.023436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249499-83b7-4b39-8170-b4d09359e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:46.024098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249499-83b7-4b39-8170-b4d09359e701 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.024376 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249499-83b7-4b39-8170-b4d09359e701 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.024652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249499-83b7-4b39-8170-b4d09359e701 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.025344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6249499-83b7-4b39-8170-b4d09359e701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:46.026674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6249499-83b7-4b39-8170-b4d09359e701 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:46.032658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 498/976] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:32:45 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:32:46.080074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1f219-4f67-4861-9755-0cd069ba75af None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:46.114624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4b2c0-5672-4e14-9c0d-72a8771aebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:46.115468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4b2c0-5672-4e14-9c0d-72a8771aebd3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.115748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4b2c0-5672-4e14-9c0d-72a8771aebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.116017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4b2c0-5672-4e14-9c0d-72a8771aebd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.128143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4b2c0-5672-4e14-9c0d-72a8771aebd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:46.129621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4b2c0-5672-4e14-9c0d-72a8771aebd3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-97a4b2c0-5672-4e14-9c0d-72a8771aebd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:46.147573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:46.148655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:46.149562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:46.149562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:46.149562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:46.149562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:46.151288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 479/977] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:46.154475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249499-83b7-4b39-8170-b4d09359e701 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:46.172834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b04e-016b-429a-921a-9f4e242417ce None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.173113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b04e-016b-429a-921a-9f4e242417ce None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.173391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b04e-016b-429a-921a-9f4e242417ce None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.174819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 480/978] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:46.180461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8781b8-614b-497c-921a-07ab99cfa52d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.180671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8781b8-614b-497c-921a-07ab99cfa52d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.180946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8781b8-614b-497c-921a-07ab99cfa52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.199183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-8f8781b8-614b-497c-921a-07ab99cfa52d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:46.200398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8f8781b8-614b-497c-921a-07ab99cfa52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:46.264004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249499-83b7-4b39-8170-b4d09359e701 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:46.269020 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 481/979] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:46.290861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8781b8-614b-497c-921a-07ab99cfa52d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:46.296603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:46.297268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.297546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.297819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.298533 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:46.298831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:46.300210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:46.312358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 499/980] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:46.317618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:46.389500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8781b8-614b-497c-921a-07ab99cfa52d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:46.414738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6841-1c7e-4200-9444-195fc3bfd547 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:46.423581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5183a-ec79-4b48-b68f-14566bd20b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:46.424243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5183a-ec79-4b48-b68f-14566bd20b0d None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.424540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5183a-ec79-4b48-b68f-14566bd20b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.424817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5183a-ec79-4b48-b68f-14566bd20b0d None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.425494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5183a-ec79-4b48-b68f-14566bd20b0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:46.426855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5183a-ec79-4b48-b68f-14566bd20b0d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:46.443075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 482/981] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:32:46 2022] POST /identity/v3/services => generated 242 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:46.457283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:46.458173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.458469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.458739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.468177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:46.469687 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:46.486434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:46.487524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:46.492959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 500/982] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:32:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:46.493599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5183a-ec79-4b48-b68f-14566bd20b0d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:46.597449 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5183a-ec79-4b48-b68f-14566bd20b0d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:46.632355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:46.633032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.633314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.633583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.634415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:46.634723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:46.636258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:46.654672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 483/983] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 16:32:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:46.659835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:46.755503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64429a1b-6296-4b36-91ff-0b1c8ba17304 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:46.787807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c895b-b83b-485e-bc4c-ae3372ab4141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:46.788453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c895b-b83b-485e-bc4c-ae3372ab4141 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:46.788732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c895b-b83b-485e-bc4c-ae3372ab4141 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:46.789003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c895b-b83b-485e-bc4c-ae3372ab4141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:46.855107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c895b-b83b-485e-bc4c-ae3372ab4141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:46.856552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c895b-b83b-485e-bc4c-ae3372ab4141 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:46.959102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 501/984] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:32:46.960501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:47.060468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69dfb5-95dc-4395-ba29-584c1588ba7d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:47.093107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:47.094160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:47.094647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:47.095135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:47.104891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:47.106578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:47.124070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:47.124981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:47.125883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:47.125883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:47.125883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:47.125883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:47.127747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 484/985] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:47.132934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c895b-b83b-485e-bc4c-ae3372ab4141 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:47.230562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c895b-b83b-485e-bc4c-ae3372ab4141 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:47.263282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:47.263947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:47.264227 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:47.264499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:47.265214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:47.265517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:47.266865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:47.282122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 502/986] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:47.283413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:47.378171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad726-8c45-408e-b0a6-ed4c8c809773 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:47.409973 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:47.410758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:47.411068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:47.411344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:47.417721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:47.419180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:47.432924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:47.434357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:47.435667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:47.435667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:47.435667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:47.435667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:47.435667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:47.435667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:47.435667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:47.435667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:47.439274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 485/987] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:47.440440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:47.534373 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e968-3bdd-4a24-9f8f-3bc08f5a4602 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:47.567572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611caf81-e3a8-4bb1-9ab5-142fa36e2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:47.568222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611caf81-e3a8-4bb1-9ab5-142fa36e2ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:47.568504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611caf81-e3a8-4bb1-9ab5-142fa36e2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:47.568776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611caf81-e3a8-4bb1-9ab5-142fa36e2ad8 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:47.569550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611caf81-e3a8-4bb1-9ab5-142fa36e2ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:47.569857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611caf81-e3a8-4bb1-9ab5-142fa36e2ad8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:47.571303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611caf81-e3a8-4bb1-9ab5-142fa36e2ad8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:47.588560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 503/988] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:47.589912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:47.686574 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1eb30-c7b6-4cae-84ea-30edaacbc34f None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:47.718495 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23056846-8d15-461a-a95e-0f56e913a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:47.719186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056846-8d15-461a-a95e-0f56e913a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:47.719470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056846-8d15-461a-a95e-0f56e913a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:47.719743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056846-8d15-461a-a95e-0f56e913a3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:47.720568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23056846-8d15-461a-a95e-0f56e913a3b4 None admin] RBAC: Adding query filter params (role.id=958301c56fca46b5bc19e26c4d062373, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=09a9cf0f43624be493e7092f3a4a8f80) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:47.720880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23056846-8d15-461a-a95e-0f56e913a3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:47.722299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23056846-8d15-461a-a95e-0f56e913a3b4 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:47.735219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 486/989] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:47 2022] GET /identity/v3/role_assignments?user.id=09a9cf0f43624be493e7092f3a4a8f80&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=958301c56fca46b5bc19e26c4d062373 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:48.307935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92d95-cc20-49b7-a86c-b6b785445e38 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:48.308486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92d95-cc20-49b7-a86c-b6b785445e38 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:48.308567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92d95-cc20-49b7-a86c-b6b785445e38 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:48.309926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 504/990] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:48.315371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415f5d-9ab1-4dee-b009-3da64c8dea60 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:48.315664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415f5d-9ab1-4dee-b009-3da64c8dea60 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:48.315944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415f5d-9ab1-4dee-b009-3da64c8dea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:48.333537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-c7415f5d-9ab1-4dee-b009-3da64c8dea60 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:48.334721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c7415f5d-9ab1-4dee-b009-3da64c8dea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:48.398455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 487/991] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:48.422102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b92d95-cc20-49b7-a86c-b6b785445e38 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:48.524728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b92d95-cc20-49b7-a86c-b6b785445e38 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:48.560358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c907838-2698-45ea-bf79-d3681354614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:48.561132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c907838-2698-45ea-bf79-d3681354614c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:48.561418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c907838-2698-45ea-bf79-d3681354614c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:48.561691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c907838-2698-45ea-bf79-d3681354614c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:48.562344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c907838-2698-45ea-bf79-d3681354614c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:48.563779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c907838-2698-45ea-bf79-d3681354614c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-5c907838-2698-45ea-bf79-d3681354614c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:48.576780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:48.577952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:48.578834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 505/992] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 16:32:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:48.586026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7415f5d-9ab1-4dee-b009-3da64c8dea60 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:48.681796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7415f5d-9ab1-4dee-b009-3da64c8dea60 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:48.700350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55e78f-aa1c-48ea-a7c1-358c47d328aa None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:48.700632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55e78f-aa1c-48ea-a7c1-358c47d328aa None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:48.700902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55e78f-aa1c-48ea-a7c1-358c47d328aa None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:48.702401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 506/993] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:48.707051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56a79-7ef1-444c-8c48-c07788258522 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:48.707333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56a79-7ef1-444c-8c48-c07788258522 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:48.707612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56a79-7ef1-444c-8c48-c07788258522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:48.715871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:48.716538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:48.716820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:48.717094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:48.717798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:48.718102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:48.719505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:48.723773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f0a56a79-7ef1-444c-8c48-c07788258522 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:48.724401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 488/994] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:48.724951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f0a56a79-7ef1-444c-8c48-c07788258522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:48.731018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:48.797993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 507/995] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:48.820128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56a79-7ef1-444c-8c48-c07788258522 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:48.829792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2775a-481d-4fa1-97c5-d3d51fd3d85c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:48.861779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:48.862771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:48.863287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:48.863561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:48.864278 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:48.864596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:48.865993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:48.872120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 489/996] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 16:32:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:48.878311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:48.918318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56a79-7ef1-444c-8c48-c07788258522 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:48.952016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:48.952844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:48.953124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:48.953398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:48.954055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:48.955457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:48.967391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:48.968439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:48.974442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 508/997] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:48.975291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:48.977598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6fdb9-ed31-4899-9c54-8e9198eecde5 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:49.011949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55310a2a-e37a-46b7-932c-5f37dc88b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:49.012951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310a2a-e37a-46b7-932c-5f37dc88b131 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:49.013252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310a2a-e37a-46b7-932c-5f37dc88b131 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:49.013524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310a2a-e37a-46b7-932c-5f37dc88b131 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:49.014233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55310a2a-e37a-46b7-932c-5f37dc88b131 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:49.015630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55310a2a-e37a-46b7-932c-5f37dc88b131 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:49.038363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 490/998] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:32:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:32:49.091795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f0de7-36ad-41c1-b79b-a213789ea7e4 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:49.134312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:49.135421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:49.135931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:49.136432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:49.137424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:49.137943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:49.139588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:49.145396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 509/999] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:49.150876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55310a2a-e37a-46b7-932c-5f37dc88b131 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:49.255805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55310a2a-e37a-46b7-932c-5f37dc88b131 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:49.288738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:49.289405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:49.289688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:49.289964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:49.290674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:49.291002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:49.292376 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:49.302595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 491/1000] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:49.303820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:49.400677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ece7-b5f3-4fb5-8133-d42c9fc2c1eb None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:49.434476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a33ee-0dd5-4b3f-b9e4-91504de63354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:49.435501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a33ee-0dd5-4b3f-b9e4-91504de63354 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:49.435974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a33ee-0dd5-4b3f-b9e4-91504de63354 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:49.436414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a33ee-0dd5-4b3f-b9e4-91504de63354 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:49.437362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a33ee-0dd5-4b3f-b9e4-91504de63354 None admin] RBAC: Adding query filter params (interface=public, service_id=45b14fbbb3fe4c258e2aef21af902fbd, region_id=RegionOne) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:49.437818 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a33ee-0dd5-4b3f-b9e4-91504de63354 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:49.439333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a33ee-0dd5-4b3f-b9e4-91504de63354 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:49.449012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 510/1001] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 16:32:49 2022] GET /identity/v3/endpoints?service_id=45b14fbbb3fe4c258e2aef21af902fbd&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:49.450416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:49.546369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85ace-05f3-472e-9326-08e5fbd8d71a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:49.580172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd57f23-fe0f-4b5c-a1d3-1d9adc36267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:49.580843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57f23-fe0f-4b5c-a1d3-1d9adc36267f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:49.581126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57f23-fe0f-4b5c-a1d3-1d9adc36267f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:49.581401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57f23-fe0f-4b5c-a1d3-1d9adc36267f None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:49.582086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57f23-fe0f-4b5c-a1d3-1d9adc36267f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:49.583502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57f23-fe0f-4b5c-a1d3-1d9adc36267f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:49.599237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 492/1002] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:32:49 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:32:49.995692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d101-3103-4ea8-9e06-d78b4af6e38f None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:49.995971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d101-3103-4ea8-9e06-d78b4af6e38f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:49.996420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d101-3103-4ea8-9e06-d78b4af6e38f None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:49.997792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 511/1003] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:50.003221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9bb00-49b9-4b99-88cc-a19cdc69e92c None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:50.003680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9bb00-49b9-4b99-88cc-a19cdc69e92c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:50.003782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9bb00-49b9-4b99-88cc-a19cdc69e92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:50.021212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-a9a9bb00-49b9-4b99-88cc-a19cdc69e92c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:50.022384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a9a9bb00-49b9-4b99-88cc-a19cdc69e92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:50.086177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 493/1004] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:50.108879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04d101-3103-4ea8-9e06-d78b4af6e38f None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:50.209472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04d101-3103-4ea8-9e06-d78b4af6e38f None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:50.241295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:50.242079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:50.242357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:50.242629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:50.243310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:50.244660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:50.256835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:50.257941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:50.258814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:50.260406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 512/1005] 10.222.0.57 () {56 vars in 1105 bytes} [Tue May 10 16:32:50 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:50.264821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9bb00-49b9-4b99-88cc-a19cdc69e92c None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:50.359018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9bb00-49b9-4b99-88cc-a19cdc69e92c None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:50.391894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d836df-ce77-41fb-a465-853a36dc8532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:50.392552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d836df-ce77-41fb-a465-853a36dc8532 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:50.392831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d836df-ce77-41fb-a465-853a36dc8532 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:50.393099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d836df-ce77-41fb-a465-853a36dc8532 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:50.393799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d836df-ce77-41fb-a465-853a36dc8532 None admin] RBAC: Adding query filter params (name=image) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:50.394103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d836df-ce77-41fb-a465-853a36dc8532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:50.395494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d836df-ce77-41fb-a465-853a36dc8532 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:50.400397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 494/1006] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:50.405817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:50.501106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5ef7-a403-4f01-b4e1-4da950b2b4c5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:50.531552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb19ef8-722a-4d5e-8c12-93902dbbdc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:50.532203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19ef8-722a-4d5e-8c12-93902dbbdc59 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:50.532485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19ef8-722a-4d5e-8c12-93902dbbdc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:50.532759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19ef8-722a-4d5e-8c12-93902dbbdc59 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:50.533480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19ef8-722a-4d5e-8c12-93902dbbdc59 None admin] RBAC: Adding query filter params (type=image) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:50.533785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19ef8-722a-4d5e-8c12-93902dbbdc59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:50.535156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19ef8-722a-4d5e-8c12-93902dbbdc59 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:50.539685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 513/1007] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:51.311936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0317be-93e0-414f-86d7-bd58838ab7e5 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:51.312482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0317be-93e0-414f-86d7-bd58838ab7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:51.312482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0317be-93e0-414f-86d7-bd58838ab7e5 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:51.313887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 495/1008] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:51.319105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281ce8-66cd-4e3e-b426-a7303384aac9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:51.319401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281ce8-66cd-4e3e-b426-a7303384aac9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:51.319684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281ce8-66cd-4e3e-b426-a7303384aac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:51.336556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-0b281ce8-66cd-4e3e-b426-a7303384aac9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:51.337738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0b281ce8-66cd-4e3e-b426-a7303384aac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:51.403685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 514/1009] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:51.426644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0317be-93e0-414f-86d7-bd58838ab7e5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:51.522923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0317be-93e0-414f-86d7-bd58838ab7e5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:51.555542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181cdf6-4b99-4125-95a9-358d1fe60921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:51.556335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cdf6-4b99-4125-95a9-358d1fe60921 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:51.556618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cdf6-4b99-4125-95a9-358d1fe60921 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:51.556894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181cdf6-4b99-4125-95a9-358d1fe60921 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:51.558095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181cdf6-4b99-4125-95a9-358d1fe60921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:51.559575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181cdf6-4b99-4125-95a9-358d1fe60921 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:51.561379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 496/1010] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:51.566940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281ce8-66cd-4e3e-b426-a7303384aac9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:51.668125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281ce8-66cd-4e3e-b426-a7303384aac9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:51.702758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf29604-3b8d-43a7-8fd9-b0815f665f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:51.703455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29604-3b8d-43a7-8fd9-b0815f665f03 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:51.703735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29604-3b8d-43a7-8fd9-b0815f665f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:51.704003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29604-3b8d-43a7-8fd9-b0815f665f03 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:51.704707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf29604-3b8d-43a7-8fd9-b0815f665f03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:51.706120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf29604-3b8d-43a7-8fd9-b0815f665f03 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:51.734996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 515/1011] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:32:51 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:32:51.841559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe5dd3-eb37-4391-8cbf-93940bbb12e2 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:51.841734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe5dd3-eb37-4391-8cbf-93940bbb12e2 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:51.842018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe5dd3-eb37-4391-8cbf-93940bbb12e2 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:51.843595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 497/1012] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:51.849013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef94f-3c78-40d6-a3bd-9dfe54782fdd None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:51.849311 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef94f-3c78-40d6-a3bd-9dfe54782fdd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:51.849596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef94f-3c78-40d6-a3bd-9dfe54782fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:51.867117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ed1ef94f-3c78-40d6-a3bd-9dfe54782fdd None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:51.868327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ed1ef94f-3c78-40d6-a3bd-9dfe54782fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:51.940950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 516/1013] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:51.963786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe5dd3-eb37-4391-8cbf-93940bbb12e2 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:52.065132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe5dd3-eb37-4391-8cbf-93940bbb12e2 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:52.097650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:52.098361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:52.098640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:52.098916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:52.099601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:52.100961 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:52.112945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:52.114168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:52.115222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 498/1014] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:52.120374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef94f-3c78-40d6-a3bd-9dfe54782fdd None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:52.216273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef94f-3c78-40d6-a3bd-9dfe54782fdd None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:52.249453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:52.250120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:52.250403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:52.250678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:52.251419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:52.251729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:52.253087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:52.257776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 517/1015] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:52.263752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:52.367899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789116df-5495-4bc4-b3b4-5b05d7163607 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:52.399305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3676b-5057-48f7-b0df-2ac3bec0d5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:52.399962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3676b-5057-48f7-b0df-2ac3bec0d5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:52.400244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3676b-5057-48f7-b0df-2ac3bec0d5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:52.400517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3676b-5057-48f7-b0df-2ac3bec0d5d9 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:52.401220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3676b-5057-48f7-b0df-2ac3bec0d5d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:52.401524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3676b-5057-48f7-b0df-2ac3bec0d5d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:52.403441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3676b-5057-48f7-b0df-2ac3bec0d5d9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:52.412653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 499/1016] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 16:32:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:52.414114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:52.509426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc643ba4-27f1-4c49-9685-f1fb2148a090 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:52.542170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dba30-6138-4cda-a956-2e6ecc0257f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:52.543467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dba30-6138-4cda-a956-2e6ecc0257f8 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:52.543753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dba30-6138-4cda-a956-2e6ecc0257f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:52.544030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dba30-6138-4cda-a956-2e6ecc0257f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:52.545037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dba30-6138-4cda-a956-2e6ecc0257f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:52.546398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dba30-6138-4cda-a956-2e6ecc0257f8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:52.570777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 518/1017] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:32:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:52.758781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d242a9-98e9-41f5-a638-ce90de4138aa None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:52.759101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d242a9-98e9-41f5-a638-ce90de4138aa None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:52.759376 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d242a9-98e9-41f5-a638-ce90de4138aa None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:52.760968 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 500/1018] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:52.767074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196255-29bc-4921-8063-765ef4082532 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:52.767365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196255-29bc-4921-8063-765ef4082532 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:52.767644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196255-29bc-4921-8063-765ef4082532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:52.784589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-2c196255-29bc-4921-8063-765ef4082532 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:52.785780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2c196255-29bc-4921-8063-765ef4082532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:52.856543 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 519/1019] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:52.878602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d242a9-98e9-41f5-a638-ce90de4138aa None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:52.980259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d242a9-98e9-41f5-a638-ce90de4138aa None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:53.013765 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721fc15-e13c-41b9-bf2c-e14293b0a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:53.014359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721fc15-e13c-41b9-bf2c-e14293b0a1db None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:53.014642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721fc15-e13c-41b9-bf2c-e14293b0a1db None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:53.014917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721fc15-e13c-41b9-bf2c-e14293b0a1db None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:53.015682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721fc15-e13c-41b9-bf2c-e14293b0a1db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:53.017053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721fc15-e13c-41b9-bf2c-e14293b0a1db None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:53.035010 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 501/1020] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:32:52 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:54.035974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909187b4-df4c-4f51-ac62-dae2c99d2494 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:54.036545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909187b4-df4c-4f51-ac62-dae2c99d2494 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:54.036545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909187b4-df4c-4f51-ac62-dae2c99d2494 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:54.038040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 520/1021] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:54.043741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98015de-bb5f-457e-b3b0-85e6b9330d7d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:54.044487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98015de-bb5f-457e-b3b0-85e6b9330d7d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:54.045020 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98015de-bb5f-457e-b3b0-85e6b9330d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:54.061292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-b98015de-bb5f-457e-b3b0-85e6b9330d7d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:54.062456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b98015de-bb5f-457e-b3b0-85e6b9330d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:54.131006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 502/1022] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:54.155207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909187b4-df4c-4f51-ac62-dae2c99d2494 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:54.254432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909187b4-df4c-4f51-ac62-dae2c99d2494 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:54.288331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fc7a5-9bd4-41c7-8ae5-744c2c2589e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:54.289116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fc7a5-9bd4-41c7-8ae5-744c2c2589e3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:54.289396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fc7a5-9bd4-41c7-8ae5-744c2c2589e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:54.289669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fc7a5-9bd4-41c7-8ae5-744c2c2589e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:54.290846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fc7a5-9bd4-41c7-8ae5-744c2c2589e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:54.292326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fc7a5-9bd4-41c7-8ae5-744c2c2589e3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:54.294137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 521/1023] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:54.300906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98015de-bb5f-457e-b3b0-85e6b9330d7d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:54.399295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98015de-bb5f-457e-b3b0-85e6b9330d7d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:54.431777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999f49e-9074-42dc-a8cb-48dab61cda93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:54.432371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999f49e-9074-42dc-a8cb-48dab61cda93 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:54.432652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999f49e-9074-42dc-a8cb-48dab61cda93 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:54.432926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999f49e-9074-42dc-a8cb-48dab61cda93 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:54.433630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999f49e-9074-42dc-a8cb-48dab61cda93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:54.435137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999f49e-9074-42dc-a8cb-48dab61cda93 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:54.462993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 503/1024] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:32:54 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:54.920149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62425a9f-cba2-475c-9f61-866f141cb8b7 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:54.920460 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62425a9f-cba2-475c-9f61-866f141cb8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:54.920696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62425a9f-cba2-475c-9f61-866f141cb8b7 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:54.922208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 522/1025] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:54.927532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db192a-1d6f-4951-a1f5-5ea966f294ac None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:54.927822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db192a-1d6f-4951-a1f5-5ea966f294ac None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:54.928100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db192a-1d6f-4951-a1f5-5ea966f294ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:54.944876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d3db192a-1d6f-4951-a1f5-5ea966f294ac None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:54.946060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d3db192a-1d6f-4951-a1f5-5ea966f294ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:55.010570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 504/1026] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:55.033454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62425a9f-cba2-475c-9f61-866f141cb8b7 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.144163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62425a9f-cba2-475c-9f61-866f141cb8b7 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.176661 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9f45e-541d-4987-91b8-5fb0f018515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.177472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f45e-541d-4987-91b8-5fb0f018515f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.177750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f45e-541d-4987-91b8-5fb0f018515f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.178017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f45e-541d-4987-91b8-5fb0f018515f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.188676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9f45e-541d-4987-91b8-5fb0f018515f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-89c9f45e-541d-4987-91b8-5fb0f018515f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:55.197150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:55.198080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:55.198942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 523/1027] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:55.205899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db192a-1d6f-4951-a1f5-5ea966f294ac None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.284512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f7e3-c59a-4dea-a896-4568895d1e1f None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.284853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f7e3-c59a-4dea-a896-4568895d1e1f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.285068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f7e3-c59a-4dea-a896-4568895d1e1f None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.286583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 524/1028] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:55.291379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b985c-85dc-431c-9d9e-6d6aa5262db1 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.291673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b985c-85dc-431c-9d9e-6d6aa5262db1 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.291957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b985c-85dc-431c-9d9e-6d6aa5262db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.302528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db192a-1d6f-4951-a1f5-5ea966f294ac None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.310771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-848b985c-85dc-431c-9d9e-6d6aa5262db1 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:55.311715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-848b985c-85dc-431c-9d9e-6d6aa5262db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:55.338157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.338825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.339640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.339910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.340733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:55.341045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:55.342417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:55.354784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 505/1029] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:55.356401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.381153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 525/1030] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:55.403672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b985c-85dc-431c-9d9e-6d6aa5262db1 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.452283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2740154-21dd-4be9-823c-256d9b30e81e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.486051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.487203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.487203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.487405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.497578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:55.499048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:55.499421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b985c-85dc-431c-9d9e-6d6aa5262db1 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:55.515741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:55.516666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:55.522293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:55.522293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:55.522293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:55.522293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:55.522293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 506/1031] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:55.522593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.540475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.541269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.541552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.541845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.543085 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:55.544447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:55.556151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:55.557169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:55.558069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 526/1032] 10.222.0.57 () {56 vars in 1105 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:55.563189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.622765 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184a948-8e4a-4d0f-bdf1-a5e8c22f7ee0 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.656733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.657318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.657603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.657878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.658608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:55.658899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:55.660301 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:55.662004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18ba2-79bc-432e-b73c-9609c3dfa6c0 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.672971 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 507/1033] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:55.678756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.696626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.697292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.697577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.697852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.699096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:55.699407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:55.700761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:55.705594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 527/1034] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:55.711165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.784361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207b414-f342-4fea-94a1-1c56700badc1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.811940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ee2b0-eb2a-418b-8b38-8965e1b074e9 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.817151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.817948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.818227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.818507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.825903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:55.827371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:55.844843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:32:55.845308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:55.846290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:32:55.852198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:55.852869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.852869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.852869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.852869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] RBAC: Adding query filter params (type=image) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:55.853173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 508/1035] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:55.853257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:55.853257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:55.853447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.861929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 528/1036] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:55.862887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:55.955348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5967-3d34-4e05-9dfc-f625b5c5c3bd None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.967105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a841d7-36c6-47a8-8ab4-ecba9abec46d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:55.988726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:55.989393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:55.989676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:55.989952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:55.990784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:55.991123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:55.992554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:55.999529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:56.000181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.000469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.000745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.001530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] RBAC: Adding query filter params (interface=public, service_id=22247e18fa0048e78a1221a51a0b7e85, region_id=RegionOne) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:56.001845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:56.003231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:56.008088 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 529/1037] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/endpoints?service_id=22247e18fa0048e78a1221a51a0b7e85&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:56.015180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 509/1038] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:32:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:56.018429 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:56.018544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:56.116229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dbe51-dcf3-4192-bedc-4943203b05b2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:56.117220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e548a-ee52-403a-88cd-ebcf5686a5aa None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:56.149485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6ea8e-684e-402f-986c-bd40992330e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:56.150256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6ea8e-684e-402f-986c-bd40992330e0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.150435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6ea8e-684e-402f-986c-bd40992330e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.150682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6ea8e-684e-402f-986c-bd40992330e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.151543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe83b-4eaf-4618-8b53-b8304f4c8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:56.152742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe83b-4eaf-4618-8b53-b8304f4c8fff None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.153018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe83b-4eaf-4618-8b53-b8304f4c8fff None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.153286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fe83b-4eaf-4618-8b53-b8304f4c8fff None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.153959 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fe83b-4eaf-4618-8b53-b8304f4c8fff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:56.155359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fe83b-4eaf-4618-8b53-b8304f4c8fff None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:56.161821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 510/1039] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:32:56 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:32:56.222236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6ea8e-684e-402f-986c-bd40992330e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:56.223670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6ea8e-684e-402f-986c-bd40992330e0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:56.330451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 530/1040] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 16:32:56.331722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe83b-4eaf-4618-8b53-b8304f4c8fff None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:56.433759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fe83b-4eaf-4618-8b53-b8304f4c8fff None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:56.475776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:56.476482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.476764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.477050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.486871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:56.488350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:56.505589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:56.506496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:56.507444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:56.507444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:56.507444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:56.507444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:56.507444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 511/1041] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:56.513803 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6ea8e-684e-402f-986c-bd40992330e0 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:56.613576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6ea8e-684e-402f-986c-bd40992330e0 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:56.646223 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a79958-c22b-4d88-a5fa-4e5de9aa168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:56.646884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79958-c22b-4d88-a5fa-4e5de9aa168a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.647212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79958-c22b-4d88-a5fa-4e5de9aa168a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.647491 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a79958-c22b-4d88-a5fa-4e5de9aa168a None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.648213 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a79958-c22b-4d88-a5fa-4e5de9aa168a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:56.648521 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a79958-c22b-4d88-a5fa-4e5de9aa168a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:56.649882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a79958-c22b-4d88-a5fa-4e5de9aa168a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:56.665937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 531/1042] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:56.667578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:56.738540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd0268-8790-4b78-a583-bf60ca68b6ec None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.738744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd0268-8790-4b78-a583-bf60ca68b6ec None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.739032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd0268-8790-4b78-a583-bf60ca68b6ec None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.740409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 532/1043] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:32:56.745644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c5419-2330-4fe3-bf74-01ba1abacbed None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.745934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c5419-2330-4fe3-bf74-01ba1abacbed None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.746214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c5419-2330-4fe3-bf74-01ba1abacbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.763847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-0a2c5419-2330-4fe3-bf74-01ba1abacbed None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:56.765013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0a2c5419-2330-4fe3-bf74-01ba1abacbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:56.767333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4de42b-b4c3-4d79-b443-286b339640d3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:56.801852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:56.802650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.802935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.803238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.809794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:56.811177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:32:56.825204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:56.826120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:56.827072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 512/1044] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:56.832171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:56.833486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 533/1045] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:32:56.857168 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c5419-2330-4fe3-bf74-01ba1abacbed None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:56.931939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b6c3-5970-4449-b5b7-50638225132e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:56.962110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c5419-2330-4fe3-bf74-01ba1abacbed None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:56.964521 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:56.965183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.965464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.965737 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:56.966527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:56.966836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:56.968297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:56.980305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 513/1046] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:56.986078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:56.996136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743cae8-f342-4c1d-8dad-fe6789d46363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:56.996870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cae8-f342-4c1d-8dad-fe6789d46363 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:56.997152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cae8-f342-4c1d-8dad-fe6789d46363 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:56.997427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cae8-f342-4c1d-8dad-fe6789d46363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:57.007531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743cae8-f342-4c1d-8dad-fe6789d46363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-7743cae8-f342-4c1d-8dad-fe6789d46363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:57.015807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:57.016756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 534/1047] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:57.022794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743cae8-f342-4c1d-8dad-fe6789d46363 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:57.085007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023d81c-a879-4c7d-aee2-345d8e27140a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:57.124083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:57.124770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:57.125056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:57.125334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:57.126181 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] RBAC: Adding query filter params (role.id=958301c56fca46b5bc19e26c4d062373, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=3d11d338bf2c4521bdfddc5d5c8da899) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:57.126497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:57.128034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:57.132823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743cae8-f342-4c1d-8dad-fe6789d46363 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:57.138448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 514/1048] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:56 2022] GET /identity/v3/role_assignments?user.id=3d11d338bf2c4521bdfddc5d5c8da899&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=958301c56fca46b5bc19e26c4d062373 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:57.184378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:57.184935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:57.185167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:57.185440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:57.186192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:57.186497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:57.188085 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:57.199704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 535/1049] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:32:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:57.205481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:57.328022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc01547-0719-4cf6-b5b5-3fcb649ef3e9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:57.362097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e43580-c8a9-4c27-a2e8-514271184226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:57.362992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e43580-c8a9-4c27-a2e8-514271184226 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:57.363267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e43580-c8a9-4c27-a2e8-514271184226 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:57.363535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e43580-c8a9-4c27-a2e8-514271184226 None admin] PATH_INFO: `/v3/users/0957c38cd3004e97bc52423858a92bcf` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:57.378097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e43580-c8a9-4c27-a2e8-514271184226 None admin] RBAC: Authorizing `identity:get_user(user_id=0957c38cd3004e97bc52423858a92bcf)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:57.379636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e43580-c8a9-4c27-a2e8-514271184226 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:57.381639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 515/1050] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:32:57 2022] GET /identity/v3/users/0957c38cd3004e97bc52423858a92bcf => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:57.390989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:57.512640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cb04c-14ae-498a-9b6d-09c917455ef3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:57.546344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69743172-a882-4f83-914f-de624c4decb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:57.547000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69743172-a882-4f83-914f-de624c4decb2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:57.547284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69743172-a882-4f83-914f-de624c4decb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:57.547555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69743172-a882-4f83-914f-de624c4decb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:57.610632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69743172-a882-4f83-914f-de624c4decb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:57.612144 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69743172-a882-4f83-914f-de624c4decb2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:57.704458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 536/1051] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:32:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:32:57.710087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e43580-c8a9-4c27-a2e8-514271184226 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:57.804696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e43580-c8a9-4c27-a2e8-514271184226 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:57.836270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47138207-49f8-49ad-a9f9-4d5060e75755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:57.837121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47138207-49f8-49ad-a9f9-4d5060e75755 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:57.837398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47138207-49f8-49ad-a9f9-4d5060e75755 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:57.837666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47138207-49f8-49ad-a9f9-4d5060e75755 None admin] PATH_INFO: `/v3/projects/f980bd77afa249e28318f52234b1c017` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:57.838829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47138207-49f8-49ad-a9f9-4d5060e75755 None admin] RBAC: Authorizing `identity:get_project(project_id=f980bd77afa249e28318f52234b1c017)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:57.840830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47138207-49f8-49ad-a9f9-4d5060e75755 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:57.847400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 516/1052] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:32:57 2022] GET /identity/v3/projects/f980bd77afa249e28318f52234b1c017 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:57.848451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69743172-a882-4f83-914f-de624c4decb2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:57.948404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69743172-a882-4f83-914f-de624c4decb2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:57.982247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ffde1-69ab-4258-91a1-24b81632a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:57.983174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffde1-69ab-4258-91a1-24b81632a74c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:57.983627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffde1-69ab-4258-91a1-24b81632a74c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:57.984062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ffde1-69ab-4258-91a1-24b81632a74c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:57.985055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ffde1-69ab-4258-91a1-24b81632a74c None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=f980bd77afa249e28318f52234b1c017, user.id=0957c38cd3004e97bc52423858a92bcf) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:57.985524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ffde1-69ab-4258-91a1-24b81632a74c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:57.987113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ffde1-69ab-4258-91a1-24b81632a74c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:57.997147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 537/1053] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:32:57 2022] GET /identity/v3/role_assignments?user.id=0957c38cd3004e97bc52423858a92bcf&scope.project.id=f980bd77afa249e28318f52234b1c017&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:58.416435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad382aa-f89c-4f0f-a61a-504c3e2544d8 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:58.416996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad382aa-f89c-4f0f-a61a-504c3e2544d8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:58.416996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad382aa-f89c-4f0f-a61a-504c3e2544d8 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:58.418925 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 517/1054] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:58.424309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a604-0e3f-4d63-959b-efd7d2cd0a37 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:58.424700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a604-0e3f-4d63-959b-efd7d2cd0a37 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:58.424895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a604-0e3f-4d63-959b-efd7d2cd0a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:58.440976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3af7a604-0e3f-4d63-959b-efd7d2cd0a37 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:58.442131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3af7a604-0e3f-4d63-959b-efd7d2cd0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:58.511129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 538/1055] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:58.527839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad382aa-f89c-4f0f-a61a-504c3e2544d8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:58.623570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad382aa-f89c-4f0f-a61a-504c3e2544d8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:58.655559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:58.656347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:58.656623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:58.656891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:58.657541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:58.658886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:58.671499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:58.672485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:32:58.673315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:58.675300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 518/1056] 10.222.0.57 () {56 vars in 1105 bytes} [Tue May 10 16:32:58 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:58.678568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7a604-0e3f-4d63-959b-efd7d2cd0a37 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:58.773733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7a604-0e3f-4d63-959b-efd7d2cd0a37 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:58.807161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:58.807852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:58.808134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:58.808407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:58.809104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:58.809404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:58.810756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:58.820112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 539/1057] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:58.821145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:58.918487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad2fd-2c9f-4abc-b6bb-36c6f3b004b1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:58.950388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328796de-03db-4f9f-b005-150a07e53d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:58.950997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328796de-03db-4f9f-b005-150a07e53d67 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:58.951275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328796de-03db-4f9f-b005-150a07e53d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:58.951546 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328796de-03db-4f9f-b005-150a07e53d67 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:58.952245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328796de-03db-4f9f-b005-150a07e53d67 None admin] RBAC: Adding query filter params (type=image) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:58.952549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328796de-03db-4f9f-b005-150a07e53d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:58.953960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328796de-03db-4f9f-b005-150a07e53d67 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:58.963294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 519/1058] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:32:58.965025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:59.058727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f2cad-8237-4c7b-a782-c45136c4ffd7 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:59.092333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802bf0e-da0b-4f4d-b209-10f277e1ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:59.093004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802bf0e-da0b-4f4d-b209-10f277e1ddc2 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:59.093286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802bf0e-da0b-4f4d-b209-10f277e1ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:59.093560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802bf0e-da0b-4f4d-b209-10f277e1ddc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:59.094321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802bf0e-da0b-4f4d-b209-10f277e1ddc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:59.095757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802bf0e-da0b-4f4d-b209-10f277e1ddc2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:59.118380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 540/1059] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:32:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:32:59.380647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6a5d2-e153-4a80-abe3-f606c225f7c5 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:59.380830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6a5d2-e153-4a80-abe3-f606c225f7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:59.381112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6a5d2-e153-4a80-abe3-f606c225f7c5 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:59.382482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 520/1060] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:32:59.388203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020901b-0c4c-40a5-9e3c-3e606ea8755b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:59.388497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020901b-0c4c-40a5-9e3c-3e606ea8755b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:59.388774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020901b-0c4c-40a5-9e3c-3e606ea8755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:59.405397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a020901b-0c4c-40a5-9e3c-3e606ea8755b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:32:59.406577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a020901b-0c4c-40a5-9e3c-3e606ea8755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:32:59.475695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 541/1061] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:32:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:32:59.498933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6a5d2-e153-4a80-abe3-f606c225f7c5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:59.599619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6a5d2-e153-4a80-abe3-f606c225f7c5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:59.632847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7ca2-b0d4-4106-a62e-1e45c0ab647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:59.633582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7ca2-b0d4-4106-a62e-1e45c0ab647d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:59.633861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7ca2-b0d4-4106-a62e-1e45c0ab647d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:59.634132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7ca2-b0d4-4106-a62e-1e45c0ab647d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:59.643993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd7ca2-b0d4-4106-a62e-1e45c0ab647d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-59fd7ca2-b0d4-4106-a62e-1e45c0ab647d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:32:59.652180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:59.653133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:59.653980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 521/1062] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 16:32:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:32:59.659696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020901b-0c4c-40a5-9e3c-3e606ea8755b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:59.754848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020901b-0c4c-40a5-9e3c-3e606ea8755b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:59.787683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:59.788345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:59.788626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:59.788899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:59.789650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:32:59.789954 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:59.791334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:59.805529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 542/1063] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 16:32:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:32:59.806811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7ca2-b0d4-4106-a62e-1e45c0ab647d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:32:59.904234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7ca2-b0d4-4106-a62e-1e45c0ab647d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:32:59.936777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:32:59.937570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:32:59.937853 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:32:59.938124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:32:59.948500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:32:59.949948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:32:59.967122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:32:59.968058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:32:59.968978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:32:59.968978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:32:59.968978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:32:59.968978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:32:59.968978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 522/1064] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:32:59.974814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.074195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81246527-8212-4639-ac33-ab6e045d8f78 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.107826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe4729-9ded-48a5-9f6f-5cbc78bbba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.108488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4729-9ded-48a5-9f6f-5cbc78bbba6b None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.108771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4729-9ded-48a5-9f6f-5cbc78bbba6b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.109048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe4729-9ded-48a5-9f6f-5cbc78bbba6b None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.109770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe4729-9ded-48a5-9f6f-5cbc78bbba6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:00.110075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe4729-9ded-48a5-9f6f-5cbc78bbba6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.111462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe4729-9ded-48a5-9f6f-5cbc78bbba6b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.127290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 543/1065] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:00.128439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.212821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab15202-b59e-4137-a583-f2bdd4087a3c None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.213110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab15202-b59e-4137-a583-f2bdd4087a3c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.213385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab15202-b59e-4137-a583-f2bdd4087a3c None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.215631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 544/1066] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:00.220472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e6448-68e7-44e5-a84c-7723f397037d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.220764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e6448-68e7-44e5-a84c-7723f397037d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.221042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e6448-68e7-44e5-a84c-7723f397037d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.228284 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667848fe-17e0-4ea5-b6e0-e5145a1e71ef None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.237050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-009e6448-68e7-44e5-a84c-7723f397037d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:00.238223 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-009e6448-68e7-44e5-a84c-7723f397037d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:00.260745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.262089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.262365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.262632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.271052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.272625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:33:00.287856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:00.288840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:00.295086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 523/1067] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:00.295689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.306732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 545/1068] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:33:00.329721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e6448-68e7-44e5-a84c-7723f397037d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.391083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892aa3-532e-4390-be5e-e93e244865c1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.423896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.424572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.424857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.425132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.425970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:00.426279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.426861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e6448-68e7-44e5-a84c-7723f397037d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.427732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.444783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 524/1069] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:00.450686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.463149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3adc91-3205-45a3-900a-134c4a1651eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.464739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3adc91-3205-45a3-900a-134c4a1651eb None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.465024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3adc91-3205-45a3-900a-134c4a1651eb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.465295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3adc91-3205-45a3-900a-134c4a1651eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.475497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3adc91-3205-45a3-900a-134c4a1651eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-ab3adc91-3205-45a3-900a-134c4a1651eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:00.483393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:00.484746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:00.485579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:00.487582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 546/1070] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:00.493508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3adc91-3205-45a3-900a-134c4a1651eb None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.550409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d9461-45f7-4076-b14e-5fdb07139e03 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.583358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.584397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.584719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.584945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.588696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3adc91-3205-45a3-900a-134c4a1651eb None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.595197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.596631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:33:00.613903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:00.615163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:00.616421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:33:00.616421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:33:00.616421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:00.616421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:00.616877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 525/1071] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:00.622733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.625576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.626255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.626539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.626815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.627602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:00.627914 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.629276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.642776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 547/1072] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:00.643643 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.718491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed8528-d884-496c-8b8f-6f1959c81501 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.740569 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887df7f-d4f5-4156-a1e5-c091b81ffa6e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.751306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.751974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.752253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.752530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.753258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:00.753566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.754934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.766647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 526/1073] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:00.772357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.774793 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f410d0f-1ab6-4b48-8ef9-f5be9d85ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.775636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f410d0f-1ab6-4b48-8ef9-f5be9d85ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.775919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f410d0f-1ab6-4b48-8ef9-f5be9d85ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.776200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f410d0f-1ab6-4b48-8ef9-f5be9d85ffc0 None admin] PATH_INFO: `/v3/users/0957c38cd3004e97bc52423858a92bcf` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.777515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f410d0f-1ab6-4b48-8ef9-f5be9d85ffc0 None admin] RBAC: Authorizing `identity:get_user(user_id=0957c38cd3004e97bc52423858a92bcf)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.778943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f410d0f-1ab6-4b48-8ef9-f5be9d85ffc0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.785135 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 548/1074] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/users/0957c38cd3004e97bc52423858a92bcf => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:00.786524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f410d0f-1ab6-4b48-8ef9-f5be9d85ffc0 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.869468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca4570-9329-4b72-bbc6-080565cf534a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.887947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f410d0f-1ab6-4b48-8ef9-f5be9d85ffc0 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:00.902769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.903747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.904023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.904293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.910781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.912253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.920763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ec0c-15a7-46cd-9c7d-6a102b2884f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:00.921630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ec0c-15a7-46cd-9c7d-6a102b2884f5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:00.921911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ec0c-15a7-46cd-9c7d-6a102b2884f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:00.922185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ec0c-15a7-46cd-9c7d-6a102b2884f5 None admin] PATH_INFO: `/v3/projects/f980bd77afa249e28318f52234b1c017` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:00.923384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ec0c-15a7-46cd-9c7d-6a102b2884f5 None admin] RBAC: Authorizing `identity:get_project(project_id=f980bd77afa249e28318f52234b1c017)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:00.924796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ec0c-15a7-46cd-9c7d-6a102b2884f5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:33:00.926148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:00.927120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:00.928037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:33:00.928037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:33:00.928037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:33:00.928037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:33:00.928037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:33:00.928037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:33:00.928037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:33:00.928037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:00.928475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 549/1075] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/projects/f980bd77afa249e28318f52234b1c017 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:00.932261 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ec0c-15a7-46cd-9c7d-6a102b2884f5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:00.932382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 527/1076] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:00.938338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:01.028534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ec0c-15a7-46cd-9c7d-6a102b2884f5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:01.033535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb1551-e7a2-4b00-b3e3-30f1dd44fac6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:01.061325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d647a55-c0f1-48b6-a789-db73c54dd0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:01.062202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d647a55-c0f1-48b6-a789-db73c54dd0dd None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:01.062477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d647a55-c0f1-48b6-a789-db73c54dd0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:01.062747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d647a55-c0f1-48b6-a789-db73c54dd0dd None admin] PATH_INFO: `/v3/projects/f980bd77afa249e28318f52234b1c017/users/0957c38cd3004e97bc52423858a92bcf/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:01.064732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d647a55-c0f1-48b6-a789-db73c54dd0dd None admin] RBAC: Authorizing `identity:create_grant(project_id=f980bd77afa249e28318f52234b1c017, user_id=0957c38cd3004e97bc52423858a92bcf, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:01.066134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d647a55-c0f1-48b6-a789-db73c54dd0dd None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:01.068018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3798e5-33e2-43f2-b47d-bce4e5ce6493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:01.068679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3798e5-33e2-43f2-b47d-bce4e5ce6493 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:01.068960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3798e5-33e2-43f2-b47d-bce4e5ce6493 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:01.069235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3798e5-33e2-43f2-b47d-bce4e5ce6493 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:01.070054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3798e5-33e2-43f2-b47d-bce4e5ce6493 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:01.070335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3798e5-33e2-43f2-b47d-bce4e5ce6493 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:01.071789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3798e5-33e2-43f2-b47d-bce4e5ce6493 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:01.079214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 550/1077] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:33:00 2022] PUT /identity/v3/projects/f980bd77afa249e28318f52234b1c017/users/0957c38cd3004e97bc52423858a92bcf/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:33:01.083403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 528/1078] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:33:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:01.092265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d647a55-c0f1-48b6-a789-db73c54dd0dd None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:01.206494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d647a55-c0f1-48b6-a789-db73c54dd0dd None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:01.244972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083b97b-7457-4eae-b116-d45f4f19fbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:01.246813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b97b-7457-4eae-b116-d45f4f19fbcc None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:01.247306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b97b-7457-4eae-b116-d45f4f19fbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:01.247801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b97b-7457-4eae-b116-d45f4f19fbcc None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/3d11d338bf2c4521bdfddc5d5c8da899/roles/958301c56fca46b5bc19e26c4d062373` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:01.250495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b97b-7457-4eae-b116-d45f4f19fbcc None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=3d11d338bf2c4521bdfddc5d5c8da899, role_id=958301c56fca46b5bc19e26c4d062373)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:01.252216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b97b-7457-4eae-b116-d45f4f19fbcc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:01.267858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 551/1079] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:33:01 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/3d11d338bf2c4521bdfddc5d5c8da899/roles/958301c56fca46b5bc19e26c4d062373 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:01.403169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b34c4-0edb-49bb-be0e-39fc33bf4619 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:01.403540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b34c4-0edb-49bb-be0e-39fc33bf4619 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:01.403723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b34c4-0edb-49bb-be0e-39fc33bf4619 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:01.405326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 529/1080] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:01.411095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5868925-ad9b-41de-ada2-7d7e80788d0c None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:01.411391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5868925-ad9b-41de-ada2-7d7e80788d0c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:01.411669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5868925-ad9b-41de-ada2-7d7e80788d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:01.429983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e5868925-ad9b-41de-ada2-7d7e80788d0c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:01.431254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e5868925-ad9b-41de-ada2-7d7e80788d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:01.500195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 552/1081] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:33:01.522780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b34c4-0edb-49bb-be0e-39fc33bf4619 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:01.621447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b34c4-0edb-49bb-be0e-39fc33bf4619 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:01.661947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba045ddd-2ff4-4bdb-b7a8-dde5d569a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:01.662523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045ddd-2ff4-4bdb-b7a8-dde5d569a3ed None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:01.662802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045ddd-2ff4-4bdb-b7a8-dde5d569a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:01.663100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045ddd-2ff4-4bdb-b7a8-dde5d569a3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:01.727746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba045ddd-2ff4-4bdb-b7a8-dde5d569a3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:01.729492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba045ddd-2ff4-4bdb-b7a8-dde5d569a3ed None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:01.825231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 530/1082] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:33:01.830710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5868925-ad9b-41de-ada2-7d7e80788d0c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:01.926450 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5868925-ad9b-41de-ada2-7d7e80788d0c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:01.958828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d096ec1-54d0-4b0d-918a-7b6f2e2473d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:01.959664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d096ec1-54d0-4b0d-918a-7b6f2e2473d6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:01.959948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d096ec1-54d0-4b0d-918a-7b6f2e2473d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:01.960220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d096ec1-54d0-4b0d-918a-7b6f2e2473d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:01.969797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d096ec1-54d0-4b0d-918a-7b6f2e2473d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:01.971249 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d096ec1-54d0-4b0d-918a-7b6f2e2473d6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-7d096ec1-54d0-4b0d-918a-7b6f2e2473d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:33:01.988641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:01.989535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:01.990416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:33:01.990416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:33:01.990416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:01.990416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:01.994700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 553/1083] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:01.996303 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba045ddd-2ff4-4bdb-b7a8-dde5d569a3ed None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:02.090311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba045ddd-2ff4-4bdb-b7a8-dde5d569a3ed None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:02.124143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d0065-7ead-45b7-b105-bee91b487784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:02.124795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d0065-7ead-45b7-b105-bee91b487784 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:02.125076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d0065-7ead-45b7-b105-bee91b487784 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:02.125349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d0065-7ead-45b7-b105-bee91b487784 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:02.126071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d0065-7ead-45b7-b105-bee91b487784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:02.126375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d0065-7ead-45b7-b105-bee91b487784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:02.127763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d0065-7ead-45b7-b105-bee91b487784 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:02.146997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 531/1084] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:03.353585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5148-946c-49e9-8775-1a025971b656 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.354122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5148-946c-49e9-8775-1a025971b656 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.354240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5148-946c-49e9-8775-1a025971b656 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.356152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 554/1085] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:03.361612 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a53347-3026-4d0d-90cf-c843a61f6d62 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.362040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a53347-3026-4d0d-90cf-c843a61f6d62 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.362173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a53347-3026-4d0d-90cf-c843a61f6d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.379656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-30a53347-3026-4d0d-90cf-c843a61f6d62 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:03.380834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-30a53347-3026-4d0d-90cf-c843a61f6d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:03.443922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 532/1086] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:03.466761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5148-946c-49e9-8775-1a025971b656 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:03.505938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76294e-7e58-41ce-ab62-7584fc41fca8 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.506227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76294e-7e58-41ce-ab62-7584fc41fca8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.506518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76294e-7e58-41ce-ab62-7584fc41fca8 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.508963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 533/1087] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:03.514467 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e7c99-7fac-460f-b8d5-363677ec8962 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.514984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e7c99-7fac-460f-b8d5-363677ec8962 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.515523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e7c99-7fac-460f-b8d5-363677ec8962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.532425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-db1e7c99-7fac-460f-b8d5-363677ec8962 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:03.533613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-db1e7c99-7fac-460f-b8d5-363677ec8962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:03.566275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5148-946c-49e9-8775-1a025971b656 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:03.596858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 534/1088] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:33:03.598588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606feb84-750c-4cab-a9d7-23d38d941589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:03.599404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606feb84-750c-4cab-a9d7-23d38d941589 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.599686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606feb84-750c-4cab-a9d7-23d38d941589 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.599962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606feb84-750c-4cab-a9d7-23d38d941589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.610250 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606feb84-750c-4cab-a9d7-23d38d941589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-606feb84-750c-4cab-a9d7-23d38d941589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:03.617899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:03.619023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:03.624972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 555/1089] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:33:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:03.626025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e7c99-7fac-460f-b8d5-363677ec8962 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:03.626123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606feb84-750c-4cab-a9d7-23d38d941589 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:03.712731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e7c99-7fac-460f-b8d5-363677ec8962 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:03.717161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606feb84-750c-4cab-a9d7-23d38d941589 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:03.746218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e24d1-9596-489f-ab87-a4a3e9728075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:03.747042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e24d1-9596-489f-ab87-a4a3e9728075 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.747325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e24d1-9596-489f-ab87-a4a3e9728075 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.747605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e24d1-9596-489f-ab87-a4a3e9728075 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.749455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:03.750110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.750387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.750656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.751423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:03.751726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:03.753067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:03.757386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e24d1-9596-489f-ab87-a4a3e9728075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:03.760789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 556/1090] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:33:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-693e24d1-9596-489f-ab87-a4a3e9728075 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:03.765697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:03.766793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:33:03.767703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:03.768356 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:03.768427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 535/1091] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 16:33:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:03.772400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e24d1-9596-489f-ab87-a4a3e9728075 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:03.863767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6366-9290-45a3-8aaa-c6ec1c52dedb None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:03.867351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e24d1-9596-489f-ab87-a4a3e9728075 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:03.895734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86342d-97f1-4467-a022-29e2066a7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:03.896603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86342d-97f1-4467-a022-29e2066a7b82 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.896884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86342d-97f1-4467-a022-29e2066a7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.897153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86342d-97f1-4467-a022-29e2066a7b82 None admin] PATH_INFO: `/v3/users/0957c38cd3004e97bc52423858a92bcf` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.898326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86342d-97f1-4467-a022-29e2066a7b82 None admin] RBAC: Authorizing `identity:get_user(user_id=0957c38cd3004e97bc52423858a92bcf)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:03.899240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:03.899764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86342d-97f1-4467-a022-29e2066a7b82 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:03.899893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:03.900172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:03.900441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:03.901174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:03.902145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:03.902255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 557/1092] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:03 2022] GET /identity/v3/users/0957c38cd3004e97bc52423858a92bcf => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:03.903384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:03.907429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86342d-97f1-4467-a022-29e2066a7b82 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:03.911078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 536/1093] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 16:33:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:03.916358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:04.004626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86342d-97f1-4467-a022-29e2066a7b82 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.007575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119de33-5565-4047-a3bd-727d3e64ef72 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.036478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663b9c-f2b3-4c8c-9b7f-1e5e4480042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.037104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663b9c-f2b3-4c8c-9b7f-1e5e4480042c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.037379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663b9c-f2b3-4c8c-9b7f-1e5e4480042c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.037650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663b9c-f2b3-4c8c-9b7f-1e5e4480042c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.039204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.039973 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.040281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.040546 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.051026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.052465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:33:04.068900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:04.069803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:04.070705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:33:04.070705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:33:04.070705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:04.070705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:04.070705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 537/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:04.076065 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:04.101444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663b9c-f2b3-4c8c-9b7f-1e5e4480042c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.102901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663b9c-f2b3-4c8c-9b7f-1e5e4480042c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.171237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb25569-b7ca-4d7d-9cdd-bd3a901b9c43 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.198140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 558/1095] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 16:33:04.204896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663b9c-f2b3-4c8c-9b7f-1e5e4480042c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:04.205253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.205914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.206196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.206471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.207233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:04.207540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.208903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.220894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 538/1096] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:04.226241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:04.296323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663b9c-f2b3-4c8c-9b7f-1e5e4480042c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.316836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d06b7-cf35-4f46-b89c-871b70246a15 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.329184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff94032-81a4-4b1b-9141-e2098e0664b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.330035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94032-81a4-4b1b-9141-e2098e0664b2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.330316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94032-81a4-4b1b-9141-e2098e0664b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.330589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94032-81a4-4b1b-9141-e2098e0664b2 None admin] PATH_INFO: `/v3/projects/f980bd77afa249e28318f52234b1c017` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.331799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff94032-81a4-4b1b-9141-e2098e0664b2 None admin] RBAC: Authorizing `identity:get_project(project_id=f980bd77afa249e28318f52234b1c017)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.333212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff94032-81a4-4b1b-9141-e2098e0664b2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.334938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 559/1097] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:04 2022] GET /identity/v3/projects/f980bd77afa249e28318f52234b1c017 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:04.341544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff94032-81a4-4b1b-9141-e2098e0664b2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:04.349666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.350449 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.350726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.351064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.357874 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.359315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:33:04.373579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:04.375204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:04.376453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 539/1098] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 16:33:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:04.380199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:04.433764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff94032-81a4-4b1b-9141-e2098e0664b2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.468166 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.468808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.469082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.469352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.470171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=f980bd77afa249e28318f52234b1c017, user.id=0957c38cd3004e97bc52423858a92bcf) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:04.470478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.471905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.475296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16d7f7-296b-4765-93b1-3cc5fa506e92 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.477470 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 560/1099] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:33:04 2022] GET /identity/v3/role_assignments?user.id=0957c38cd3004e97bc52423858a92bcf&scope.project.id=f980bd77afa249e28318f52234b1c017&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:04.509987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.510678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.510986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.511271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.512126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:04.512435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.513907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.533229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 540/1100] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 16:33:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:04.539306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:04.639861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411528d-d254-417c-afb5-9083f1e6462c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.674622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb391f-9314-47a9-b695-fb3630ce7364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.675300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb391f-9314-47a9-b695-fb3630ce7364 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.675580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb391f-9314-47a9-b695-fb3630ce7364 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.675854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb391f-9314-47a9-b695-fb3630ce7364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.740221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb391f-9314-47a9-b695-fb3630ce7364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.741583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb391f-9314-47a9-b695-fb3630ce7364 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.835964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 561/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 16:33:04.842177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:04.935540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa81319-f5ca-4c22-91b0-c3cde1f4c902 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:04.969796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:04.970590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:04.970872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:04.971251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:04.980804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:04.982241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:33:04.999214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:05.000325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:05.001497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:33:05.001497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:33:05.001497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:05.001497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:05.003123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 541/1102] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:05.005875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb391f-9314-47a9-b695-fb3630ce7364 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:05.100412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb391f-9314-47a9-b695-fb3630ce7364 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:05.132376 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:05.133031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:05.133315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:05.133592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:05.134309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:05.134613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:05.136590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:05.147282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 562/1103] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:05.152765 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:05.251012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5b1d-444d-4d52-b333-a5c36e5fc0f7 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:05.284094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:05.284876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:05.285157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:05.285430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:05.291830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:05.293296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:33:05.306884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:05.308366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:05.309276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 542/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:05.314329 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:05.409355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ad57-39c4-418b-b7c9-7acf08952ad1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:05.441213 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37522-d18c-4e0d-93e2-e3b3df3d6ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:05.441857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37522-d18c-4e0d-93e2-e3b3df3d6ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:05.442137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37522-d18c-4e0d-93e2-e3b3df3d6ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:05.442412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37522-d18c-4e0d-93e2-e3b3df3d6ed6 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:05.443225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37522-d18c-4e0d-93e2-e3b3df3d6ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:05.443533 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37522-d18c-4e0d-93e2-e3b3df3d6ed6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:05.444952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37522-d18c-4e0d-93e2-e3b3df3d6ed6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:05.456904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 563/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:05.462722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:05.556404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbef8c-7b73-4bc6-b6f3-9a9a493327e8 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:05.587824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4dd06-5832-4101-91a0-8a3e8725965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:05.588469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4dd06-5832-4101-91a0-8a3e8725965e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:05.588752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4dd06-5832-4101-91a0-8a3e8725965e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:05.589063 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4dd06-5832-4101-91a0-8a3e8725965e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:05.589890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4dd06-5832-4101-91a0-8a3e8725965e None admin] RBAC: Adding query filter params (role.id=958301c56fca46b5bc19e26c4d062373, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=3d11d338bf2c4521bdfddc5d5c8da899) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:05.590201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4dd06-5832-4101-91a0-8a3e8725965e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:05.591664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4dd06-5832-4101-91a0-8a3e8725965e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:05.597427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 543/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:33:05 2022] GET /identity/v3/role_assignments?user.id=3d11d338bf2c4521bdfddc5d5c8da899&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=958301c56fca46b5bc19e26c4d062373 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:06.721199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b64d-4da4-42af-823e-4f18e703e9eb None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:06.721751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b64d-4da4-42af-823e-4f18e703e9eb None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:06.721751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b64d-4da4-42af-823e-4f18e703e9eb None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:06.723121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 564/1107] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:06.728326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b950edf-4591-46e0-8aca-0b6f975a930b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:06.728745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b950edf-4591-46e0-8aca-0b6f975a930b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:06.728886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b950edf-4591-46e0-8aca-0b6f975a930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:06.745621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3b950edf-4591-46e0-8aca-0b6f975a930b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:06.746809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3b950edf-4591-46e0-8aca-0b6f975a930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:06.809250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 544/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:06.833837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b64d-4da4-42af-823e-4f18e703e9eb None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:06.929478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b64d-4da4-42af-823e-4f18e703e9eb None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:06.961520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e995ece-f933-4e37-84ff-0500b4cb23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:06.962292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e995ece-f933-4e37-84ff-0500b4cb23a4 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:06.962566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e995ece-f933-4e37-84ff-0500b4cb23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:06.962831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e995ece-f933-4e37-84ff-0500b4cb23a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:06.964018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e995ece-f933-4e37-84ff-0500b4cb23a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:06.965427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e995ece-f933-4e37-84ff-0500b4cb23a4 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:06.967043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 565/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:33:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:06.972754 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b950edf-4591-46e0-8aca-0b6f975a930b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:07.063978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b950edf-4591-46e0-8aca-0b6f975a930b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:07.094705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38018e3-fbf9-4aef-bc97-58c4dbcbff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:07.095374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38018e3-fbf9-4aef-bc97-58c4dbcbff67 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:07.095657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38018e3-fbf9-4aef-bc97-58c4dbcbff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:07.095930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38018e3-fbf9-4aef-bc97-58c4dbcbff67 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:07.096622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38018e3-fbf9-4aef-bc97-58c4dbcbff67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:07.098032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38018e3-fbf9-4aef-bc97-58c4dbcbff67 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:07.116740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 545/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:33:06 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:09.356402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede134c0-babd-491d-aa45-1adcaaac1142 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:09.356967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede134c0-babd-491d-aa45-1adcaaac1142 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:09.356967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede134c0-babd-491d-aa45-1adcaaac1142 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:09.358296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 566/1111] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:09.363422 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e53a8-073e-4dc2-9f3a-1619a5414955 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:09.363790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e53a8-073e-4dc2-9f3a-1619a5414955 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:09.363982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e53a8-073e-4dc2-9f3a-1619a5414955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:09.380108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-260e53a8-073e-4dc2-9f3a-1619a5414955 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:09.381281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-260e53a8-073e-4dc2-9f3a-1619a5414955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:09.443395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 546/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:09.467381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede134c0-babd-491d-aa45-1adcaaac1142 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:09.561672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede134c0-babd-491d-aa45-1adcaaac1142 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:09.593315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e839-331c-4ce6-906d-0503204fd3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:09.594145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e839-331c-4ce6-906d-0503204fd3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:09.594421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e839-331c-4ce6-906d-0503204fd3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:09.594689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e839-331c-4ce6-906d-0503204fd3d5 None admin] PATH_INFO: `/v3/roles/a3a8307844964e028f49d8bcff278ded` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:09.596141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e839-331c-4ce6-906d-0503204fd3d5 None admin] RBAC: Authorizing `identity:get_role(role_id=a3a8307844964e028f49d8bcff278ded)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:09.597478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9e839-331c-4ce6-906d-0503204fd3d5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:09.598791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 567/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:09 2022] GET /identity/v3/roles/a3a8307844964e028f49d8bcff278ded => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:09.604451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e53a8-073e-4dc2-9f3a-1619a5414955 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:09.696430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e53a8-073e-4dc2-9f3a-1619a5414955 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:09.727985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3812-e017-4283-bd55-dc3578633a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:09.728836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3812-e017-4283-bd55-dc3578633a1c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:09.729117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3812-e017-4283-bd55-dc3578633a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:09.729410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3812-e017-4283-bd55-dc3578633a1c None admin] PATH_INFO: `/v3/users/5cd6e5a258d147b288b26149f31d20c8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:09.741877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3812-e017-4283-bd55-dc3578633a1c None admin] RBAC: Authorizing `identity:get_user(user_id=5cd6e5a258d147b288b26149f31d20c8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:09.743343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3812-e017-4283-bd55-dc3578633a1c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:09.744963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 547/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:09 2022] GET /identity/v3/users/5cd6e5a258d147b288b26149f31d20c8 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:09.750850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e839-331c-4ce6-906d-0503204fd3d5 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:09.842683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e839-331c-4ce6-906d-0503204fd3d5 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:09.874277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db1ae3-d99c-4447-a227-2f90454fe943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:09.874915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db1ae3-d99c-4447-a227-2f90454fe943 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:09.875224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db1ae3-d99c-4447-a227-2f90454fe943 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:09.875497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db1ae3-d99c-4447-a227-2f90454fe943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:09.939521 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db1ae3-d99c-4447-a227-2f90454fe943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:09.940969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db1ae3-d99c-4447-a227-2f90454fe943 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:10.033982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 568/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:33:10.039943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3812-e017-4283-bd55-dc3578633a1c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:10.132438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3812-e017-4283-bd55-dc3578633a1c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:10.162926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63b21a-dedc-4de3-8105-f3c492d47615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:10.163896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b21a-dedc-4de3-8105-f3c492d47615 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:10.164173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b21a-dedc-4de3-8105-f3c492d47615 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:10.164442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b21a-dedc-4de3-8105-f3c492d47615 None admin] PATH_INFO: `/v3/projects/f980bd77afa249e28318f52234b1c017` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:10.165599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63b21a-dedc-4de3-8105-f3c492d47615 None admin] RBAC: Authorizing `identity:get_project(project_id=f980bd77afa249e28318f52234b1c017)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:10.167552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63b21a-dedc-4de3-8105-f3c492d47615 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:10.169176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 548/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:10 2022] GET /identity/v3/projects/f980bd77afa249e28318f52234b1c017 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:10.175318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db1ae3-d99c-4447-a227-2f90454fe943 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:10.267489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db1ae3-d99c-4447-a227-2f90454fe943 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:10.299561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d613d54-173b-4acd-8791-a6dbe693d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:10.300231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613d54-173b-4acd-8791-a6dbe693d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:10.300512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613d54-173b-4acd-8791-a6dbe693d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:10.300783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d613d54-173b-4acd-8791-a6dbe693d1a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:10.301595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d613d54-173b-4acd-8791-a6dbe693d1a8 None admin] RBAC: Adding query filter params (role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=f980bd77afa249e28318f52234b1c017, user.id=5cd6e5a258d147b288b26149f31d20c8) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:10.301904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d613d54-173b-4acd-8791-a6dbe693d1a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:10.303331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d613d54-173b-4acd-8791-a6dbe693d1a8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:10.309024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 569/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:33:10 2022] GET /identity/v3/role_assignments?user.id=5cd6e5a258d147b288b26149f31d20c8&scope.project.id=f980bd77afa249e28318f52234b1c017&role.id=a3a8307844964e028f49d8bcff278ded => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:12.515242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0da51-ee14-48ae-bb6d-b3e94a435b46 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:12.515775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0da51-ee14-48ae-bb6d-b3e94a435b46 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:12.515775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0da51-ee14-48ae-bb6d-b3e94a435b46 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:12.517147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 549/1118] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:12.522158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4c529-bbd6-4345-b93f-b6bd02e79dec None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:12.522604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4c529-bbd6-4345-b93f-b6bd02e79dec None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:12.522696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4c529-bbd6-4345-b93f-b6bd02e79dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:12.538689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-27c4c529-bbd6-4345-b93f-b6bd02e79dec None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:12.539923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-27c4c529-bbd6-4345-b93f-b6bd02e79dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:12.601976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 570/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:12.624740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0da51-ee14-48ae-bb6d-b3e94a435b46 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:12.720118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0da51-ee14-48ae-bb6d-b3e94a435b46 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:12.752099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244223c-0719-4bfb-8189-56a6d9469636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:12.752928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244223c-0719-4bfb-8189-56a6d9469636 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:12.753206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244223c-0719-4bfb-8189-56a6d9469636 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:12.753475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244223c-0719-4bfb-8189-56a6d9469636 None admin] PATH_INFO: `/v3/roles/a3a8307844964e028f49d8bcff278ded` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:12.754936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244223c-0719-4bfb-8189-56a6d9469636 None admin] RBAC: Authorizing `identity:get_role(role_id=a3a8307844964e028f49d8bcff278ded)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:12.756328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244223c-0719-4bfb-8189-56a6d9469636 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:12.757655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 550/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:12 2022] GET /identity/v3/roles/a3a8307844964e028f49d8bcff278ded => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:12.763771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4c529-bbd6-4345-b93f-b6bd02e79dec None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:12.856009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4c529-bbd6-4345-b93f-b6bd02e79dec None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:12.888500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1a420-d0e1-4177-9480-45a28a878772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:12.889360 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1a420-d0e1-4177-9480-45a28a878772 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:12.889638 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1a420-d0e1-4177-9480-45a28a878772 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:12.889908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1a420-d0e1-4177-9480-45a28a878772 None admin] PATH_INFO: `/v3/users/5cd6e5a258d147b288b26149f31d20c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:12.891100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1a420-d0e1-4177-9480-45a28a878772 None admin] RBAC: Authorizing `identity:get_user(user_id=5cd6e5a258d147b288b26149f31d20c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:12.892521 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1a420-d0e1-4177-9480-45a28a878772 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:12.894132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 571/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:12 2022] GET /identity/v3/users/5cd6e5a258d147b288b26149f31d20c8 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:12.899890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244223c-0719-4bfb-8189-56a6d9469636 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:12.992079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244223c-0719-4bfb-8189-56a6d9469636 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:13.023931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25440e1-f04a-402e-8460-2ec1835b9486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:13.024773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25440e1-f04a-402e-8460-2ec1835b9486 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:13.025057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25440e1-f04a-402e-8460-2ec1835b9486 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:13.025328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25440e1-f04a-402e-8460-2ec1835b9486 None admin] PATH_INFO: `/v3/projects/f980bd77afa249e28318f52234b1c017` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:13.026487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25440e1-f04a-402e-8460-2ec1835b9486 None admin] RBAC: Authorizing `identity:get_project(project_id=f980bd77afa249e28318f52234b1c017)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:13.028052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25440e1-f04a-402e-8460-2ec1835b9486 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:13.029712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 551/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:12 2022] GET /identity/v3/projects/f980bd77afa249e28318f52234b1c017 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:13.035876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1a420-d0e1-4177-9480-45a28a878772 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:13.132152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1a420-d0e1-4177-9480-45a28a878772 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:13.165913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa5065-fbd2-454f-a743-24786869482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:13.166777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa5065-fbd2-454f-a743-24786869482d None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:13.167614 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa5065-fbd2-454f-a743-24786869482d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:13.167886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa5065-fbd2-454f-a743-24786869482d None admin] PATH_INFO: `/v3/projects/f980bd77afa249e28318f52234b1c017/users/5cd6e5a258d147b288b26149f31d20c8/roles/a3a8307844964e028f49d8bcff278ded` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:13.170302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa5065-fbd2-454f-a743-24786869482d None admin] RBAC: Authorizing `identity:create_grant(project_id=f980bd77afa249e28318f52234b1c017, user_id=5cd6e5a258d147b288b26149f31d20c8, role_id=a3a8307844964e028f49d8bcff278ded)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:13.171742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa5065-fbd2-454f-a743-24786869482d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:13.184189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 572/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:33:13 2022] PUT /identity/v3/projects/f980bd77afa249e28318f52234b1c017/users/5cd6e5a258d147b288b26149f31d20c8/roles/a3a8307844964e028f49d8bcff278ded => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:15.352839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcf17f-bded-4e06-a742-8a4c620629dc None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:15.353394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcf17f-bded-4e06-a742-8a4c620629dc None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:15.353394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcf17f-bded-4e06-a742-8a4c620629dc None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:15.354864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 552/1124] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:15.360095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4c4f-e04b-4ba4-b334-584030740c58 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:15.360466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4c4f-e04b-4ba4-b334-584030740c58 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:15.360645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4c4f-e04b-4ba4-b334-584030740c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:15.376690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e0cd4c4f-e04b-4ba4-b334-584030740c58 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:15.377866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e0cd4c4f-e04b-4ba4-b334-584030740c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:15.440338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 573/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:15.463217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcf17f-bded-4e06-a742-8a4c620629dc None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:15.556993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcf17f-bded-4e06-a742-8a4c620629dc None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:15.588013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d775a-0cc7-4459-9a2c-711f8f8faa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:15.589412 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d775a-0cc7-4459-9a2c-711f8f8faa84 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:15.589688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d775a-0cc7-4459-9a2c-711f8f8faa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:15.589956 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d775a-0cc7-4459-9a2c-711f8f8faa84 None admin] PATH_INFO: `/v3/roles/a3a8307844964e028f49d8bcff278ded` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:15.591417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d775a-0cc7-4459-9a2c-711f8f8faa84 None admin] RBAC: Authorizing `identity:get_role(role_id=a3a8307844964e028f49d8bcff278ded)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:15.592776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d775a-0cc7-4459-9a2c-711f8f8faa84 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:15.594117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 553/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:15 2022] GET /identity/v3/roles/a3a8307844964e028f49d8bcff278ded => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:15.599678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4c4f-e04b-4ba4-b334-584030740c58 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:15.691485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4c4f-e04b-4ba4-b334-584030740c58 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:15.722947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff293b6f-10af-4b2e-bf40-88508172b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:15.723813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff293b6f-10af-4b2e-bf40-88508172b065 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:15.724093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff293b6f-10af-4b2e-bf40-88508172b065 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:15.724366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff293b6f-10af-4b2e-bf40-88508172b065 None admin] PATH_INFO: `/v3/users/5cd6e5a258d147b288b26149f31d20c8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:15.725523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff293b6f-10af-4b2e-bf40-88508172b065 None admin] RBAC: Authorizing `identity:get_user(user_id=5cd6e5a258d147b288b26149f31d20c8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:15.726932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff293b6f-10af-4b2e-bf40-88508172b065 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:15.728530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 574/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:15 2022] GET /identity/v3/users/5cd6e5a258d147b288b26149f31d20c8 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:15.733948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d775a-0cc7-4459-9a2c-711f8f8faa84 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:15.825978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d775a-0cc7-4459-9a2c-711f8f8faa84 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:15.856508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df54938-023b-40af-b337-f572d7a38360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:15.857124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df54938-023b-40af-b337-f572d7a38360 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:15.857402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df54938-023b-40af-b337-f572d7a38360 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:15.857670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df54938-023b-40af-b337-f572d7a38360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:15.920603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df54938-023b-40af-b337-f572d7a38360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:15.922047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df54938-023b-40af-b337-f572d7a38360 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:16.015416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 554/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:33:16.021163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff293b6f-10af-4b2e-bf40-88508172b065 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:16.114046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff293b6f-10af-4b2e-bf40-88508172b065 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:16.145632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a178d-e170-4d5d-ba5a-557ba042cd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:16.146466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a178d-e170-4d5d-ba5a-557ba042cd81 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:16.146746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a178d-e170-4d5d-ba5a-557ba042cd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:16.147047 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a178d-e170-4d5d-ba5a-557ba042cd81 None admin] PATH_INFO: `/v3/projects/f980bd77afa249e28318f52234b1c017` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:16.148212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a178d-e170-4d5d-ba5a-557ba042cd81 None admin] RBAC: Authorizing `identity:get_project(project_id=f980bd77afa249e28318f52234b1c017)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:16.149628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a178d-e170-4d5d-ba5a-557ba042cd81 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:16.151347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 575/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:16 2022] GET /identity/v3/projects/f980bd77afa249e28318f52234b1c017 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:16.157180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df54938-023b-40af-b337-f572d7a38360 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:16.250899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df54938-023b-40af-b337-f572d7a38360 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:16.281647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a3733-3582-4918-8f72-72bd3432ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:16.282226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a3733-3582-4918-8f72-72bd3432ae10 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:16.282502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a3733-3582-4918-8f72-72bd3432ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:16.282771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a3733-3582-4918-8f72-72bd3432ae10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:16.283609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a3733-3582-4918-8f72-72bd3432ae10 None admin] RBAC: Adding query filter params (role.id=a3a8307844964e028f49d8bcff278ded, scope.project.id=f980bd77afa249e28318f52234b1c017, user.id=5cd6e5a258d147b288b26149f31d20c8) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:16.283915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a3733-3582-4918-8f72-72bd3432ae10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:16.285324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a3733-3582-4918-8f72-72bd3432ae10 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:16.290722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 555/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:33:16 2022] GET /identity/v3/role_assignments?user.id=5cd6e5a258d147b288b26149f31d20c8&scope.project.id=f980bd77afa249e28318f52234b1c017&role.id=a3a8307844964e028f49d8bcff278ded => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:18.525506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9851b-aede-404a-9637-447f5cc88bda None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:18.526076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9851b-aede-404a-9637-447f5cc88bda None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:18.526076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9851b-aede-404a-9637-447f5cc88bda None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:18.528035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 576/1131] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:18.533294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a928-f264-459f-b1d0-36174768ce19 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:18.533694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a928-f264-459f-b1d0-36174768ce19 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:18.533845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a928-f264-459f-b1d0-36174768ce19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:18.550204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-fee0a928-f264-459f-b1d0-36174768ce19 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:18.551400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fee0a928-f264-459f-b1d0-36174768ce19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:18.613824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 556/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:18.637189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9851b-aede-404a-9637-447f5cc88bda None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:18.730536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9851b-aede-404a-9637-447f5cc88bda None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:18.762603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a055-fcf1-4a77-883a-bc32cdd9a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:18.763390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a055-fcf1-4a77-883a-bc32cdd9a7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:18.763672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a055-fcf1-4a77-883a-bc32cdd9a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:18.763944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a055-fcf1-4a77-883a-bc32cdd9a7b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:18.765095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a055-fcf1-4a77-883a-bc32cdd9a7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:18.766512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a055-fcf1-4a77-883a-bc32cdd9a7b7 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:18.768113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 577/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:33:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:18.773738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a928-f264-459f-b1d0-36174768ce19 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:18.866448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a928-f264-459f-b1d0-36174768ce19 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:18.902626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead9ab2-4cfa-4a27-8ac8-3c5e2d14e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:18.903466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9ab2-4cfa-4a27-8ac8-3c5e2d14e1ab None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:18.903752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9ab2-4cfa-4a27-8ac8-3c5e2d14e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:18.904028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9ab2-4cfa-4a27-8ac8-3c5e2d14e1ab None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:18.904725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead9ab2-4cfa-4a27-8ac8-3c5e2d14e1ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:18.906153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead9ab2-4cfa-4a27-8ac8-3c5e2d14e1ab None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:18.930699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 557/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:33:18 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:21.158246 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9232-3f24-47c8-ab37-deca79b0bf3d None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:21.158800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9232-3f24-47c8-ab37-deca79b0bf3d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:21.158894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9232-3f24-47c8-ab37-deca79b0bf3d None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:21.160220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 578/1135] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:21.165520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c9ee-b18d-465d-abcd-4ce701263225 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:21.165945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c9ee-b18d-465d-abcd-4ce701263225 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:21.166062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c9ee-b18d-465d-abcd-4ce701263225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:21.183030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-af56c9ee-b18d-465d-abcd-4ce701263225 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:21.184193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-af56c9ee-b18d-465d-abcd-4ce701263225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:21.244802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 558/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:33:21.269270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9232-3f24-47c8-ab37-deca79b0bf3d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:21.365954 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9232-3f24-47c8-ab37-deca79b0bf3d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:21.397499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b5a9a-9d3c-4d5c-8b19-05a88e7937d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:21.398267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5a9a-9d3c-4d5c-8b19-05a88e7937d0 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:21.398544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5a9a-9d3c-4d5c-8b19-05a88e7937d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:21.398812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5a9a-9d3c-4d5c-8b19-05a88e7937d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:21.399986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b5a9a-9d3c-4d5c-8b19-05a88e7937d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:21.402084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b5a9a-9d3c-4d5c-8b19-05a88e7937d0 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:21.403690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 579/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:33:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:21.409443 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c9ee-b18d-465d-abcd-4ce701263225 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:21.501533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c9ee-b18d-465d-abcd-4ce701263225 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:21.533739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd0515-eb3b-481b-9b91-a530fe3edf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:21.534391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0515-eb3b-481b-9b91-a530fe3edf34 None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:21.534674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0515-eb3b-481b-9b91-a530fe3edf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:21.534950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0515-eb3b-481b-9b91-a530fe3edf34 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:21.535675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0515-eb3b-481b-9b91-a530fe3edf34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:21.537097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0515-eb3b-481b-9b91-a530fe3edf34 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:21.556892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 559/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:33:21 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:23.766419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b959e-1e02-4800-a0d0-862b5e1d6eb8 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:23.766987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b959e-1e02-4800-a0d0-862b5e1d6eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:23.766987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b959e-1e02-4800-a0d0-862b5e1d6eb8 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:23.768363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 580/1139] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:23.773619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03143f12-b742-4af9-9c34-d8f63ffd4cc0 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:23.774017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03143f12-b742-4af9-9c34-d8f63ffd4cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:23.774172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03143f12-b742-4af9-9c34-d8f63ffd4cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:23.790836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-03143f12-b742-4af9-9c34-d8f63ffd4cc0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:23.792043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-03143f12-b742-4af9-9c34-d8f63ffd4cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:23.854692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 560/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:23.878194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b959e-1e02-4800-a0d0-862b5e1d6eb8 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:23.974092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b959e-1e02-4800-a0d0-862b5e1d6eb8 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.005719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa74b4e-b57b-451c-96e9-8a6cf6e9dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.006484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa74b4e-b57b-451c-96e9-8a6cf6e9dcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.006774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa74b4e-b57b-451c-96e9-8a6cf6e9dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.007104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa74b4e-b57b-451c-96e9-8a6cf6e9dcc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.017305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa74b4e-b57b-451c-96e9-8a6cf6e9dcc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-0aa74b4e-b57b-451c-96e9-8a6cf6e9dcc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:24.025012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:24.026090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:24.027147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:24.031048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 581/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:33:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:24.032202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03143f12-b742-4af9-9c34-d8f63ffd4cc0 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.123607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03143f12-b742-4af9-9c34-d8f63ffd4cc0 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.155092 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.155748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.156020 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.156288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.157021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:24.157324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.158678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.166194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 561/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:24.172112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa74b4e-b57b-451c-96e9-8a6cf6e9dcc3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.274048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa74b4e-b57b-451c-96e9-8a6cf6e9dcc3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.305889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8359539-b76c-457a-81ec-dc55e1f1553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.306741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8359539-b76c-457a-81ec-dc55e1f1553f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.307046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8359539-b76c-457a-81ec-dc55e1f1553f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.307894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8359539-b76c-457a-81ec-dc55e1f1553f None admin] PATH_INFO: `/v3/users/89e2d62d768c4b53b05f21a734be602a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.320326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8359539-b76c-457a-81ec-dc55e1f1553f None admin] RBAC: Authorizing `identity:get_user(user_id=89e2d62d768c4b53b05f21a734be602a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.321737 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8359539-b76c-457a-81ec-dc55e1f1553f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.323444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 582/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/users/89e2d62d768c4b53b05f21a734be602a => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:24.329125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.422030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d40b8-8cf9-4918-85cd-1181f3fa8ea3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.452802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ab894-7fe7-40c2-a934-73f6234fea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.453428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ab894-7fe7-40c2-a934-73f6234fea2b None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.453730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ab894-7fe7-40c2-a934-73f6234fea2b None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.453998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ab894-7fe7-40c2-a934-73f6234fea2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.515466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ab894-7fe7-40c2-a934-73f6234fea2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.516874 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ab894-7fe7-40c2-a934-73f6234fea2b None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.609024 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 562/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:33:24.614860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8359539-b76c-457a-81ec-dc55e1f1553f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.705881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8359539-b76c-457a-81ec-dc55e1f1553f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.737695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c53ad8-9cce-456b-9893-442cbf3a8668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.738534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53ad8-9cce-456b-9893-442cbf3a8668 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.738812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53ad8-9cce-456b-9893-442cbf3a8668 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.739119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53ad8-9cce-456b-9893-442cbf3a8668 None admin] PATH_INFO: `/v3/projects/b6315bb07afc4fae9e949e9ae8ad3c4e` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.740267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c53ad8-9cce-456b-9893-442cbf3a8668 None admin] RBAC: Authorizing `identity:get_project(project_id=b6315bb07afc4fae9e949e9ae8ad3c4e)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.741675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c53ad8-9cce-456b-9893-442cbf3a8668 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.743409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 583/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/projects/b6315bb07afc4fae9e949e9ae8ad3c4e => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:24.749186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ab894-7fe7-40c2-a934-73f6234fea2b None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.839491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ab894-7fe7-40c2-a934-73f6234fea2b None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.870782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d159a60-ca9d-4854-a2bc-9723e5ccb15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.871378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159a60-ca9d-4854-a2bc-9723e5ccb15e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.871653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159a60-ca9d-4854-a2bc-9723e5ccb15e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.871920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d159a60-ca9d-4854-a2bc-9723e5ccb15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.872729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d159a60-ca9d-4854-a2bc-9723e5ccb15e None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=b6315bb07afc4fae9e949e9ae8ad3c4e, user.id=89e2d62d768c4b53b05f21a734be602a) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:24.873031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d159a60-ca9d-4854-a2bc-9723e5ccb15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.874438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d159a60-ca9d-4854-a2bc-9723e5ccb15e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.879678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 563/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/role_assignments?user.id=89e2d62d768c4b53b05f21a734be602a&scope.project.id=b6315bb07afc4fae9e949e9ae8ad3c4e&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:27.025339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41fdb0-250e-4f20-932c-231ec1aa453b None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.025882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41fdb0-250e-4f20-932c-231ec1aa453b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.025882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41fdb0-250e-4f20-932c-231ec1aa453b None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.027288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 584/1147] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:27.032402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54d507-f226-40f6-9fbf-9c97406fff45 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.032817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54d507-f226-40f6-9fbf-9c97406fff45 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.032954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54d507-f226-40f6-9fbf-9c97406fff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.049185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-2f54d507-f226-40f6-9fbf-9c97406fff45 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:27.050346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-2f54d507-f226-40f6-9fbf-9c97406fff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:27.111501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 564/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:27.133337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41fdb0-250e-4f20-932c-231ec1aa453b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:27.230232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41fdb0-250e-4f20-932c-231ec1aa453b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:27.261611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628eb10-0173-48a6-b3b1-0306a3edaf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:27.262381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628eb10-0173-48a6-b3b1-0306a3edaf89 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.262660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628eb10-0173-48a6-b3b1-0306a3edaf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.262934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628eb10-0173-48a6-b3b1-0306a3edaf89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.272403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628eb10-0173-48a6-b3b1-0306a3edaf89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1628eb10-0173-48a6-b3b1-0306a3edaf89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:27.280113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:27.281170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:27.282039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 585/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:33:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:27.287222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54d507-f226-40f6-9fbf-9c97406fff45 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:27.382719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54d507-f226-40f6-9fbf-9c97406fff45 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:27.413890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:27.414533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.414809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.415104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.415835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:27.416134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:27.418009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:27.425821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 565/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:33:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:27.431849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628eb10-0173-48a6-b3b1-0306a3edaf89 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:27.524987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628eb10-0173-48a6-b3b1-0306a3edaf89 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:27.556397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6a0f-f4b7-4c42-9202-3ad65cdabe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:27.557834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6a0f-f4b7-4c42-9202-3ad65cdabe9c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.558116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6a0f-f4b7-4c42-9202-3ad65cdabe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.558393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6a0f-f4b7-4c42-9202-3ad65cdabe9c None admin] PATH_INFO: `/v3/users/89e2d62d768c4b53b05f21a734be602a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.559588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab6a0f-f4b7-4c42-9202-3ad65cdabe9c None admin] RBAC: Authorizing `identity:get_user(user_id=89e2d62d768c4b53b05f21a734be602a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:27.561005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab6a0f-f4b7-4c42-9202-3ad65cdabe9c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:27.562598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 586/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:27 2022] GET /identity/v3/users/89e2d62d768c4b53b05f21a734be602a => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:27.568105 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:27.661389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dc8f2-b09c-41f1-b9e6-35690f449157 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:27.693701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd196bb-5acb-4b0d-85ac-553bffc42264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:27.694487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd196bb-5acb-4b0d-85ac-553bffc42264 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.694761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd196bb-5acb-4b0d-85ac-553bffc42264 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.695057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd196bb-5acb-4b0d-85ac-553bffc42264 None admin] PATH_INFO: `/v3/projects/b6315bb07afc4fae9e949e9ae8ad3c4e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.696213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd196bb-5acb-4b0d-85ac-553bffc42264 None admin] RBAC: Authorizing `identity:get_project(project_id=b6315bb07afc4fae9e949e9ae8ad3c4e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:27.697628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd196bb-5acb-4b0d-85ac-553bffc42264 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:27.699857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 566/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:27 2022] GET /identity/v3/projects/b6315bb07afc4fae9e949e9ae8ad3c4e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:27.705601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6a0f-f4b7-4c42-9202-3ad65cdabe9c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:27.797983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6a0f-f4b7-4c42-9202-3ad65cdabe9c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:27.829623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a039a-7a11-4564-9295-bbd8913ca2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:27.830479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a039a-7a11-4564-9295-bbd8913ca2d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.830757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a039a-7a11-4564-9295-bbd8913ca2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.831054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a039a-7a11-4564-9295-bbd8913ca2d8 None admin] PATH_INFO: `/v3/projects/b6315bb07afc4fae9e949e9ae8ad3c4e/users/89e2d62d768c4b53b05f21a734be602a/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.832963 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a039a-7a11-4564-9295-bbd8913ca2d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6315bb07afc4fae9e949e9ae8ad3c4e, user_id=89e2d62d768c4b53b05f21a734be602a, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:27.834368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a039a-7a11-4564-9295-bbd8913ca2d8 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:27.846548 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 587/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:33:27 2022] PUT /identity/v3/projects/b6315bb07afc4fae9e949e9ae8ad3c4e/users/89e2d62d768c4b53b05f21a734be602a/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:30.044795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c331-bca9-43c9-ba11-d433002f6d0c None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.045584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c331-bca9-43c9-ba11-d433002f6d0c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.045584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c331-bca9-43c9-ba11-d433002f6d0c None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:30.046970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 567/1154] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:30.052076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45809ae-f2dc-4e72-94e4-2e2861de12af None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.052497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45809ae-f2dc-4e72-94e4-2e2861de12af None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.052635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45809ae-f2dc-4e72-94e4-2e2861de12af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:30.068745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f45809ae-f2dc-4e72-94e4-2e2861de12af None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:30.069916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f45809ae-f2dc-4e72-94e4-2e2861de12af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:30.131869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 588/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:30.155405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c331-bca9-43c9-ba11-d433002f6d0c None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:30.250423 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c331-bca9-43c9-ba11-d433002f6d0c None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:30.282350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80936d32-ff65-46f7-b80b-20b2b4af6653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:30.283155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80936d32-ff65-46f7-b80b-20b2b4af6653 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.283440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80936d32-ff65-46f7-b80b-20b2b4af6653 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.283716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80936d32-ff65-46f7-b80b-20b2b4af6653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:30.293189 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80936d32-ff65-46f7-b80b-20b2b4af6653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-80936d32-ff65-46f7-b80b-20b2b4af6653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:30.301096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:30.302175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:30.303250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 568/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:30.308272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45809ae-f2dc-4e72-94e4-2e2861de12af None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:30.401745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45809ae-f2dc-4e72-94e4-2e2861de12af None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:30.433058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:30.433642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.433921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.434194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:30.434940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:30.435416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:30.436760 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:30.444323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 589/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:30.450417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80936d32-ff65-46f7-b80b-20b2b4af6653 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:30.543461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80936d32-ff65-46f7-b80b-20b2b4af6653 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:30.574873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa10c2-ecf5-429a-8fcb-99bdbeb31fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:30.575752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa10c2-ecf5-429a-8fcb-99bdbeb31fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.576036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa10c2-ecf5-429a-8fcb-99bdbeb31fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.576309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa10c2-ecf5-429a-8fcb-99bdbeb31fc9 None admin] PATH_INFO: `/v3/users/89e2d62d768c4b53b05f21a734be602a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:30.577487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa10c2-ecf5-429a-8fcb-99bdbeb31fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=89e2d62d768c4b53b05f21a734be602a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:30.578916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa10c2-ecf5-429a-8fcb-99bdbeb31fc9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:30.580525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 569/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:30 2022] GET /identity/v3/users/89e2d62d768c4b53b05f21a734be602a => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:30.586191 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:30.680527 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6296c7d-3c40-4943-95ab-40ad290fa7bd None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:30.712603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d61b0-19a8-449e-a440-a2075234b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:30.713170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d61b0-19a8-449e-a440-a2075234b824 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.713469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d61b0-19a8-449e-a440-a2075234b824 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.713742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d61b0-19a8-449e-a440-a2075234b824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:30.775929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d61b0-19a8-449e-a440-a2075234b824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:30.777391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d61b0-19a8-449e-a440-a2075234b824 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:30.867377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 590/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:33:30.873634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa10c2-ecf5-429a-8fcb-99bdbeb31fc9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:30.966301 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa10c2-ecf5-429a-8fcb-99bdbeb31fc9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:30.997522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f25a-9f77-4928-be06-4fb25899869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:30.998360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f25a-9f77-4928-be06-4fb25899869a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.998638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f25a-9f77-4928-be06-4fb25899869a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.998911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f25a-9f77-4928-be06-4fb25899869a None admin] PATH_INFO: `/v3/projects/b6315bb07afc4fae9e949e9ae8ad3c4e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:31.000100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f25a-9f77-4928-be06-4fb25899869a None admin] RBAC: Authorizing `identity:get_project(project_id=b6315bb07afc4fae9e949e9ae8ad3c4e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:31.001514 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f25a-9f77-4928-be06-4fb25899869a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:31.003184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 570/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:30 2022] GET /identity/v3/projects/b6315bb07afc4fae9e949e9ae8ad3c4e => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:31.009166 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d61b0-19a8-449e-a440-a2075234b824 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:31.100240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d61b0-19a8-449e-a440-a2075234b824 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:31.132259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb230a0-c359-454a-b928-aed3e8649ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:31.132889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb230a0-c359-454a-b928-aed3e8649ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:31.133168 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb230a0-c359-454a-b928-aed3e8649ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:31.133441 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb230a0-c359-454a-b928-aed3e8649ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:31.134258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb230a0-c359-454a-b928-aed3e8649ce1 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=b6315bb07afc4fae9e949e9ae8ad3c4e, user.id=89e2d62d768c4b53b05f21a734be602a) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:31.134568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb230a0-c359-454a-b928-aed3e8649ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:31.136032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb230a0-c359-454a-b928-aed3e8649ce1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:31.141490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 591/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:33:31 2022] GET /identity/v3/role_assignments?user.id=89e2d62d768c4b53b05f21a734be602a&scope.project.id=b6315bb07afc4fae9e949e9ae8ad3c4e&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:33.350947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd206f-46ed-4173-b965-137cde67455a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:33.351542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd206f-46ed-4173-b965-137cde67455a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:33.351542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd206f-46ed-4173-b965-137cde67455a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:33.352873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 571/1162] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:33.358519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88f8d-b4ca-4c17-b1ab-5a589a8ea043 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:33.358941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88f8d-b4ca-4c17-b1ab-5a589a8ea043 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:33.359068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88f8d-b4ca-4c17-b1ab-5a589a8ea043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:33.375044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-61d88f8d-b4ca-4c17-b1ab-5a589a8ea043 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:33.376195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-61d88f8d-b4ca-4c17-b1ab-5a589a8ea043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:33.437694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 592/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:33:33.458935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd206f-46ed-4173-b965-137cde67455a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:33.554780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd206f-46ed-4173-b965-137cde67455a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:33.585007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f797-10c4-40e3-b923-00df1eeb7c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:33.585629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f797-10c4-40e3-b923-00df1eeb7c4a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:33.585906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f797-10c4-40e3-b923-00df1eeb7c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:33.586175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9f797-10c4-40e3-b923-00df1eeb7c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:33.649917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9f797-10c4-40e3-b923-00df1eeb7c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:33.651975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9f797-10c4-40e3-b923-00df1eeb7c4a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:33.741922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 572/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:33:33.748071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88f8d-b4ca-4c17-b1ab-5a589a8ea043 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:33.839556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88f8d-b4ca-4c17-b1ab-5a589a8ea043 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:33.871271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3b674-55cc-4009-beac-31fa4e8903dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:33.872053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3b674-55cc-4009-beac-31fa4e8903dc None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:33.872330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3b674-55cc-4009-beac-31fa4e8903dc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:33.872627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3b674-55cc-4009-beac-31fa4e8903dc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:33.879215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3b674-55cc-4009-beac-31fa4e8903dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:33.880620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3b674-55cc-4009-beac-31fa4e8903dc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-27a3b674-55cc-4009-beac-31fa4e8903dc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:33.894757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:33.895973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:33.896827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 593/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:33:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:33.901837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f797-10c4-40e3-b923-00df1eeb7c4a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:33.994105 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9f797-10c4-40e3-b923-00df1eeb7c4a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:34.030222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d760b-a877-4a31-abc1-df8841619f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:34.030862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d760b-a877-4a31-abc1-df8841619f0d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:34.031163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d760b-a877-4a31-abc1-df8841619f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:34.031431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d760b-a877-4a31-abc1-df8841619f0d None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:34.032137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d760b-a877-4a31-abc1-df8841619f0d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:34.032437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d760b-a877-4a31-abc1-df8841619f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:34.033785 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d760b-a877-4a31-abc1-df8841619f0d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:34.040518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 573/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 16:33:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:36.234392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ffce2-23e9-464a-a8ec-dc4088001b3a None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:36.235014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ffce2-23e9-464a-a8ec-dc4088001b3a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:36.235014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ffce2-23e9-464a-a8ec-dc4088001b3a None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:36.236321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 594/1167] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:36.241563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed170-143e-42d6-a21d-c22c1157aa4f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:36.241963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed170-143e-42d6-a21d-c22c1157aa4f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:36.242120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed170-143e-42d6-a21d-c22c1157aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:36.259021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-248ed170-143e-42d6-a21d-c22c1157aa4f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:36.260807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-248ed170-143e-42d6-a21d-c22c1157aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:36.324880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 574/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:36.347105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ffce2-23e9-464a-a8ec-dc4088001b3a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:36.441395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ffce2-23e9-464a-a8ec-dc4088001b3a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:36.472972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd967b2-d03b-4e87-bb05-53c9b895d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:36.473606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd967b2-d03b-4e87-bb05-53c9b895d3f1 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:36.473882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd967b2-d03b-4e87-bb05-53c9b895d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:36.474151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd967b2-d03b-4e87-bb05-53c9b895d3f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:36.474872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd967b2-d03b-4e87-bb05-53c9b895d3f1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:36.476245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd967b2-d03b-4e87-bb05-53c9b895d3f1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:36.490628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 595/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Tue May 10 16:33:36 2022] POST /identity/v3/domains => generated 267 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:38.729483 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513e64-abf8-4cc5-82ea-af2387c7cb81 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:38.730051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513e64-abf8-4cc5-82ea-af2387c7cb81 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:38.730051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513e64-abf8-4cc5-82ea-af2387c7cb81 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:38.731430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 575/1170] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:38.736568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a966a-fcc6-4e39-83ed-65054ceebe14 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:38.736953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a966a-fcc6-4e39-83ed-65054ceebe14 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:38.737132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a966a-fcc6-4e39-83ed-65054ceebe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:38.753776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5f4a966a-fcc6-4e39-83ed-65054ceebe14 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:38.754947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5f4a966a-fcc6-4e39-83ed-65054ceebe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:38.817691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 596/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:38.841612 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513e64-abf8-4cc5-82ea-af2387c7cb81 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:38.936831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513e64-abf8-4cc5-82ea-af2387c7cb81 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:38.968675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3fc95-64fb-434f-8250-3afbbb805924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:38.969512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fc95-64fb-434f-8250-3afbbb805924 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:38.969789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fc95-64fb-434f-8250-3afbbb805924 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:38.970058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3fc95-64fb-434f-8250-3afbbb805924 None admin] PATH_INFO: `/v3/domains/e72568af9e55496cb6d5376ea09e403e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:38.979849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3fc95-64fb-434f-8250-3afbbb805924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e72568af9e55496cb6d5376ea09e403e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:38.981243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3fc95-64fb-434f-8250-3afbbb805924 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:38.982833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 576/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Tue May 10 16:33:38 2022] GET /identity/v3/domains/e72568af9e55496cb6d5376ea09e403e => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:38.988528 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a966a-fcc6-4e39-83ed-65054ceebe14 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.079889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a966a-fcc6-4e39-83ed-65054ceebe14 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:39.111375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d36a-8ea3-4924-a066-6b74b6ad1c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:39.112003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d36a-8ea3-4924-a066-6b74b6ad1c36 None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.112281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d36a-8ea3-4924-a066-6b74b6ad1c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.112549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d36a-8ea3-4924-a066-6b74b6ad1c36 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.113243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815d36a-8ea3-4924-a066-6b74b6ad1c36 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:39.114647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815d36a-8ea3-4924-a066-6b74b6ad1c36 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:39.139361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 597/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:33:38 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:41.382773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007e81-777d-4f78-8897-9a42ed79d7fb None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.383366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007e81-777d-4f78-8897-9a42ed79d7fb None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.383366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9007e81-777d-4f78-8897-9a42ed79d7fb None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.384695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 577/1174] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:41.390474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e04b-b8c9-49c3-8696-26da2e2d1a4d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.390897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e04b-b8c9-49c3-8696-26da2e2d1a4d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.391056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e04b-b8c9-49c3-8696-26da2e2d1a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.407642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-98b1e04b-b8c9-49c3-8696-26da2e2d1a4d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:41.408799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-98b1e04b-b8c9-49c3-8696-26da2e2d1a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:41.470149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 598/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:41.493845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9007e81-777d-4f78-8897-9a42ed79d7fb None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.589545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9007e81-777d-4f78-8897-9a42ed79d7fb None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.621511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005cf4e-b8d6-45fc-809f-82af089f928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.622350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005cf4e-b8d6-45fc-809f-82af089f928f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.622627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005cf4e-b8d6-45fc-809f-82af089f928f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.622922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005cf4e-b8d6-45fc-809f-82af089f928f None admin] PATH_INFO: `/v3/domains/e72568af9e55496cb6d5376ea09e403e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.624106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005cf4e-b8d6-45fc-809f-82af089f928f None admin] RBAC: Authorizing `identity:get_domain(domain_id=e72568af9e55496cb6d5376ea09e403e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.625523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005cf4e-b8d6-45fc-809f-82af089f928f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.627104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 578/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Tue May 10 16:33:41 2022] GET /identity/v3/domains/e72568af9e55496cb6d5376ea09e403e => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:41.632527 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e04b-b8c9-49c3-8696-26da2e2d1a4d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.723997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e04b-b8c9-49c3-8696-26da2e2d1a4d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.755607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c706a39-70e9-4815-9e14-10bb506cb57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.756248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706a39-70e9-4815-9e14-10bb506cb57f None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.756524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706a39-70e9-4815-9e14-10bb506cb57f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.756792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706a39-70e9-4815-9e14-10bb506cb57f None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.757472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c706a39-70e9-4815-9e14-10bb506cb57f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.758874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c706a39-70e9-4815-9e14-10bb506cb57f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.778115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 599/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:33:41 2022] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:44.018701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab673e-b32e-4ba0-b5cb-dc343c11a02e None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.019294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab673e-b32e-4ba0-b5cb-dc343c11a02e None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.019294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab673e-b32e-4ba0-b5cb-dc343c11a02e None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.020676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 579/1178] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:44.025853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac3871-4188-4fd8-a390-a839f674be76 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.026288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac3871-4188-4fd8-a390-a839f674be76 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.026420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac3871-4188-4fd8-a390-a839f674be76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.043223 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b9ac3871-4188-4fd8-a390-a839f674be76 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:44.044392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b9ac3871-4188-4fd8-a390-a839f674be76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:44.107424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 600/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:44.130253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab673e-b32e-4ba0-b5cb-dc343c11a02e None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.224234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab673e-b32e-4ba0-b5cb-dc343c11a02e None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.256174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f5642-78d5-4b2b-af93-20ceb2aa2261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.256937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5642-78d5-4b2b-af93-20ceb2aa2261 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.257213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5642-78d5-4b2b-af93-20ceb2aa2261 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.257481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f5642-78d5-4b2b-af93-20ceb2aa2261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.266845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f5642-78d5-4b2b-af93-20ceb2aa2261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ad8f5642-78d5-4b2b-af93-20ceb2aa2261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:44.274397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:44.275584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:44.276836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 580/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:44.281401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac3871-4188-4fd8-a390-a839f674be76 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.374690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac3871-4188-4fd8-a390-a839f674be76 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.405876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.406533 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.406816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.407121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.407864 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:44.408168 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:44.409512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:44.417671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 601/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:44.423601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f5642-78d5-4b2b-af93-20ceb2aa2261 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.516532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f5642-78d5-4b2b-af93-20ceb2aa2261 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.548082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924293f6-558e-4787-ac87-9fa3d4184883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.548933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924293f6-558e-4787-ac87-9fa3d4184883 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.549215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924293f6-558e-4787-ac87-9fa3d4184883 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.549488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924293f6-558e-4787-ac87-9fa3d4184883 None admin] PATH_INFO: `/v3/users/18c8f7bd8bb44a8b8c3227315d3da5dd` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.561686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924293f6-558e-4787-ac87-9fa3d4184883 None admin] RBAC: Authorizing `identity:get_user(user_id=18c8f7bd8bb44a8b8c3227315d3da5dd)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:44.563141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924293f6-558e-4787-ac87-9fa3d4184883 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:44.564731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 581/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/users/18c8f7bd8bb44a8b8c3227315d3da5dd => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:44.570286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.663600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1b83f-cb65-4153-ac4c-fb870d0f760f None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.695099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506f687-5785-407e-bc76-adb2ea2b9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.695726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f687-5785-407e-bc76-adb2ea2b9eee None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.696009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f687-5785-407e-bc76-adb2ea2b9eee None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.696280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f687-5785-407e-bc76-adb2ea2b9eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.758326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506f687-5785-407e-bc76-adb2ea2b9eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:44.759795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506f687-5785-407e-bc76-adb2ea2b9eee None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:44.850582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 602/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:33:44.856822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924293f6-558e-4787-ac87-9fa3d4184883 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.949254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924293f6-558e-4787-ac87-9fa3d4184883 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.980772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f15ad8-702c-4ca4-a87d-dfc31c06135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.981610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f15ad8-702c-4ca4-a87d-dfc31c06135b None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.981887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f15ad8-702c-4ca4-a87d-dfc31c06135b None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.982157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f15ad8-702c-4ca4-a87d-dfc31c06135b None admin] PATH_INFO: `/v3/projects/27874f7305b9478caa2a8d8dd3829507` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.983353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f15ad8-702c-4ca4-a87d-dfc31c06135b None admin] RBAC: Authorizing `identity:get_project(project_id=27874f7305b9478caa2a8d8dd3829507)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:44.984769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f15ad8-702c-4ca4-a87d-dfc31c06135b None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:44.986407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 582/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/projects/27874f7305b9478caa2a8d8dd3829507 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:44.992355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506f687-5785-407e-bc76-adb2ea2b9eee None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.084782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506f687-5785-407e-bc76-adb2ea2b9eee None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.116610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260466e-f626-4931-9941-7f830f5c2341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.117184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260466e-f626-4931-9941-7f830f5c2341 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.117464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260466e-f626-4931-9941-7f830f5c2341 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.117739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260466e-f626-4931-9941-7f830f5c2341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.118561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260466e-f626-4931-9941-7f830f5c2341 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=27874f7305b9478caa2a8d8dd3829507, user.id=18c8f7bd8bb44a8b8c3227315d3da5dd) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:45.118871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260466e-f626-4931-9941-7f830f5c2341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:45.120338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260466e-f626-4931-9941-7f830f5c2341 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:45.125467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 603/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/role_assignments?user.id=18c8f7bd8bb44a8b8c3227315d3da5dd&scope.project.id=27874f7305b9478caa2a8d8dd3829507&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:47.301796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb9618-d290-40f8-9bba-1696411f6b17 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.302363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb9618-d290-40f8-9bba-1696411f6b17 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.302363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb9618-d290-40f8-9bba-1696411f6b17 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.303797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 583/1186] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:47.308911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab35a-4c52-4644-9f3d-823943fd995e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.309352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab35a-4c52-4644-9f3d-823943fd995e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.309466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab35a-4c52-4644-9f3d-823943fd995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.326015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-671ab35a-4c52-4644-9f3d-823943fd995e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:47.327205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-671ab35a-4c52-4644-9f3d-823943fd995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:47.389512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 604/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:47.414840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb9618-d290-40f8-9bba-1696411f6b17 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:47.508145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb9618-d290-40f8-9bba-1696411f6b17 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:47.539171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b16d61-3c86-4f8a-9c96-c4f465efe9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:47.539934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b16d61-3c86-4f8a-9c96-c4f465efe9dd None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.540210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b16d61-3c86-4f8a-9c96-c4f465efe9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.540479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b16d61-3c86-4f8a-9c96-c4f465efe9dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.550070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b16d61-3c86-4f8a-9c96-c4f465efe9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-f0b16d61-3c86-4f8a-9c96-c4f465efe9dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:47.558211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:47.559324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:33:47.560347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 584/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:47.565239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ab35a-4c52-4644-9f3d-823943fd995e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:47.657232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ab35a-4c52-4644-9f3d-823943fd995e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:47.689002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:47.689648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.689930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.690205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.690942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:47.691279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:47.692639 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:47.700842 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 605/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:47.706378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b16d61-3c86-4f8a-9c96-c4f465efe9dd None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:47.798250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b16d61-3c86-4f8a-9c96-c4f465efe9dd None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:47.829391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653ef5-1e2c-43ca-9acf-358ec9e97a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:47.830172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653ef5-1e2c-43ca-9acf-358ec9e97a9e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.830446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653ef5-1e2c-43ca-9acf-358ec9e97a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.830711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653ef5-1e2c-43ca-9acf-358ec9e97a9e None admin] PATH_INFO: `/v3/users/18c8f7bd8bb44a8b8c3227315d3da5dd` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.831895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de653ef5-1e2c-43ca-9acf-358ec9e97a9e None admin] RBAC: Authorizing `identity:get_user(user_id=18c8f7bd8bb44a8b8c3227315d3da5dd)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:47.833303 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de653ef5-1e2c-43ca-9acf-358ec9e97a9e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:47.834861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 585/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:47 2022] GET /identity/v3/users/18c8f7bd8bb44a8b8c3227315d3da5dd => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:47.840560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:47.935102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5edbf-0bde-436f-b1e4-6a9640a30031 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:47.965446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfc97e-61d6-4a2c-acea-f7444ed355f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:47.966287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc97e-61d6-4a2c-acea-f7444ed355f2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.966566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc97e-61d6-4a2c-acea-f7444ed355f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.966840 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfc97e-61d6-4a2c-acea-f7444ed355f2 None admin] PATH_INFO: `/v3/projects/27874f7305b9478caa2a8d8dd3829507` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.968027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfc97e-61d6-4a2c-acea-f7444ed355f2 None admin] RBAC: Authorizing `identity:get_project(project_id=27874f7305b9478caa2a8d8dd3829507)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:47.969440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfc97e-61d6-4a2c-acea-f7444ed355f2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:47.971129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 606/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:47 2022] GET /identity/v3/projects/27874f7305b9478caa2a8d8dd3829507 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:47.976985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653ef5-1e2c-43ca-9acf-358ec9e97a9e None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:48.078335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653ef5-1e2c-43ca-9acf-358ec9e97a9e None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:48.109331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f7129-d8ac-4901-afd8-9fb2a4cc2de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:48.110145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7129-d8ac-4901-afd8-9fb2a4cc2de0 None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:48.110424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7129-d8ac-4901-afd8-9fb2a4cc2de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:48.110695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7129-d8ac-4901-afd8-9fb2a4cc2de0 None admin] PATH_INFO: `/v3/projects/27874f7305b9478caa2a8d8dd3829507/users/18c8f7bd8bb44a8b8c3227315d3da5dd/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:48.112642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7129-d8ac-4901-afd8-9fb2a4cc2de0 None admin] RBAC: Authorizing `identity:create_grant(project_id=27874f7305b9478caa2a8d8dd3829507, user_id=18c8f7bd8bb44a8b8c3227315d3da5dd, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:48.114060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7129-d8ac-4901-afd8-9fb2a4cc2de0 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:48.126609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 586/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:33:47 2022] PUT /identity/v3/projects/27874f7305b9478caa2a8d8dd3829507/users/18c8f7bd8bb44a8b8c3227315d3da5dd/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:50.342941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82043e-26bb-4ee0-9f2b-a24c071f427b None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.343492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82043e-26bb-4ee0-9f2b-a24c071f427b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.343492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82043e-26bb-4ee0-9f2b-a24c071f427b None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.344865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 607/1193] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:50.349974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f44b88-3805-4c19-97ee-0fd14db71a48 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.350371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f44b88-3805-4c19-97ee-0fd14db71a48 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.350535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f44b88-3805-4c19-97ee-0fd14db71a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.366645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-27f44b88-3805-4c19-97ee-0fd14db71a48 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:50.367840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-27f44b88-3805-4c19-97ee-0fd14db71a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:50.430120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 587/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:33:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:33:50.453028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82043e-26bb-4ee0-9f2b-a24c071f427b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.548517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82043e-26bb-4ee0-9f2b-a24c071f427b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:50.580057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8174ca1-b191-4e46-a140-223fc91742b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:50.580827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8174ca1-b191-4e46-a140-223fc91742b2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.581105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8174ca1-b191-4e46-a140-223fc91742b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.581373 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8174ca1-b191-4e46-a140-223fc91742b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.590754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8174ca1-b191-4e46-a140-223fc91742b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-e8174ca1-b191-4e46-a140-223fc91742b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:50.598412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:50.599562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:33:50.600655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 608/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:50.605802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f44b88-3805-4c19-97ee-0fd14db71a48 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.698660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f44b88-3805-4c19-97ee-0fd14db71a48 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:50.730201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:50.730847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.731162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.731439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.732188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:50.732497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:50.733858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:50.741453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 588/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:50.747578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8174ca1-b191-4e46-a140-223fc91742b2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.839796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8174ca1-b191-4e46-a140-223fc91742b2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:50.871107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422dc8cf-4b84-4735-8f19-2feb718a609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:50.871893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dc8cf-4b84-4735-8f19-2feb718a609b None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.872168 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dc8cf-4b84-4735-8f19-2feb718a609b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.872436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dc8cf-4b84-4735-8f19-2feb718a609b None admin] PATH_INFO: `/v3/users/18c8f7bd8bb44a8b8c3227315d3da5dd` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.873599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422dc8cf-4b84-4735-8f19-2feb718a609b None admin] RBAC: Authorizing `identity:get_user(user_id=18c8f7bd8bb44a8b8c3227315d3da5dd)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:50.875052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422dc8cf-4b84-4735-8f19-2feb718a609b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:50.876646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 609/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/users/18c8f7bd8bb44a8b8c3227315d3da5dd => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:50.882157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.976134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c14469-1d05-491d-ac5b-88b15ea666f1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.006717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236564-2cd5-49ec-831a-b1c068693059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.007361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236564-2cd5-49ec-831a-b1c068693059 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.007642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236564-2cd5-49ec-831a-b1c068693059 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.007912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236564-2cd5-49ec-831a-b1c068693059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.070049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12236564-2cd5-49ec-831a-b1c068693059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.071527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12236564-2cd5-49ec-831a-b1c068693059 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.162607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 589/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:33:51.168408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422dc8cf-4b84-4735-8f19-2feb718a609b None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.261087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422dc8cf-4b84-4735-8f19-2feb718a609b None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.291502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769868c-c7a1-4ed1-bf9a-d5a60e8fff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.292326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769868c-c7a1-4ed1-bf9a-d5a60e8fff90 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.292601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769868c-c7a1-4ed1-bf9a-d5a60e8fff90 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.292870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769868c-c7a1-4ed1-bf9a-d5a60e8fff90 None admin] PATH_INFO: `/v3/projects/27874f7305b9478caa2a8d8dd3829507` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.294009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769868c-c7a1-4ed1-bf9a-d5a60e8fff90 None admin] RBAC: Authorizing `identity:get_project(project_id=27874f7305b9478caa2a8d8dd3829507)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.295697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769868c-c7a1-4ed1-bf9a-d5a60e8fff90 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.297333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 610/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/projects/27874f7305b9478caa2a8d8dd3829507 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:51.303139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236564-2cd5-49ec-831a-b1c068693059 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.395969 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236564-2cd5-49ec-831a-b1c068693059 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.429677 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cec9a-ae00-442e-98a4-a552294d2277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.430312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cec9a-ae00-442e-98a4-a552294d2277 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.430597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cec9a-ae00-442e-98a4-a552294d2277 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.430871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cec9a-ae00-442e-98a4-a552294d2277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.432238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cec9a-ae00-442e-98a4-a552294d2277 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=27874f7305b9478caa2a8d8dd3829507, user.id=18c8f7bd8bb44a8b8c3227315d3da5dd) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:51.432552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cec9a-ae00-442e-98a4-a552294d2277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.433981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cec9a-ae00-442e-98a4-a552294d2277 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.439721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 590/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/role_assignments?user.id=18c8f7bd8bb44a8b8c3227315d3da5dd&scope.project.id=27874f7305b9478caa2a8d8dd3829507&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:51.674058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2e40-cf84-4903-9aa4-c0df3319c1f9 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.674058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2e40-cf84-4903-9aa4-c0df3319c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.674058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2e40-cf84-4903-9aa4-c0df3319c1f9 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.675153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 611/1201] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:51.682410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989720ec-e1cf-4f24-8d79-01008148784a None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.683164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989720ec-e1cf-4f24-8d79-01008148784a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.683261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989720ec-e1cf-4f24-8d79-01008148784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.706491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-989720ec-e1cf-4f24-8d79-01008148784a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:51.708008 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-989720ec-e1cf-4f24-8d79-01008148784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:51.795025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 591/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:34:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:34:51.819586 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f2e40-cf84-4903-9aa4-c0df3319c1f9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.968935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f2e40-cf84-4903-9aa4-c0df3319c1f9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.020287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.021310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.021727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.021978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.035883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.037644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:52.061328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:52.062452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:52.063482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:52.063482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:52.063482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:52.063482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:34:52.068819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 612/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:52.069959 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989720ec-e1cf-4f24-8d79-01008148784a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.200855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989720ec-e1cf-4f24-8d79-01008148784a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.242907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69ace-aec1-492b-9d28-c9f93061b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.243508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69ace-aec1-492b-9d28-c9f93061b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.243797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69ace-aec1-492b-9d28-c9f93061b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.244072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69ace-aec1-492b-9d28-c9f93061b6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.244801 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec69ace-aec1-492b-9d28-c9f93061b6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:52.245116 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec69ace-aec1-492b-9d28-c9f93061b6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.246605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec69ace-aec1-492b-9d28-c9f93061b6a6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.262481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 592/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:52.271124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.387967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3385cce-9862-4c0c-aa28-e535d59dbf2a None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.428730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b102b-955f-453f-8228-da2765f8307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.429413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b102b-955f-453f-8228-da2765f8307a None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.429698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b102b-955f-453f-8228-da2765f8307a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.430546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b102b-955f-453f-8228-da2765f8307a None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.431301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b102b-955f-453f-8228-da2765f8307a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.432750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b102b-955f-453f-8228-da2765f8307a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.455526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 613/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 16:34:52 2022] POST /identity/v3/users => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:54.969638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f33b9-309a-4ee0-b5a7-fbd559598f01 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.970275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f33b9-309a-4ee0-b5a7-fbd559598f01 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.970275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f33b9-309a-4ee0-b5a7-fbd559598f01 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.971896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 593/1206] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:54.977735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23330357-c8df-4661-ae8a-e5a6066eb56c None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.978205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23330357-c8df-4661-ae8a-e5a6066eb56c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.978298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23330357-c8df-4661-ae8a-e5a6066eb56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.996130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-23330357-c8df-4661-ae8a-e5a6066eb56c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:54.997411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-23330357-c8df-4661-ae8a-e5a6066eb56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:55.080282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 614/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:34:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:34:55.107728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f33b9-309a-4ee0-b5a7-fbd559598f01 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.222194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f33b9-309a-4ee0-b5a7-fbd559598f01 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.262496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869b2cd-22f9-4ad3-af9f-33d49430df9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.263325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869b2cd-22f9-4ad3-af9f-33d49430df9d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.263609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869b2cd-22f9-4ad3-af9f-33d49430df9d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.263915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869b2cd-22f9-4ad3-af9f-33d49430df9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.275861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869b2cd-22f9-4ad3-af9f-33d49430df9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-2869b2cd-22f9-4ad3-af9f-33d49430df9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:55.284679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:55.285736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:34:55.286796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 594/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:55.291906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23330357-c8df-4661-ae8a-e5a6066eb56c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.402588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23330357-c8df-4661-ae8a-e5a6066eb56c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.445629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.446315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.446593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.446864 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.447722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:55.448086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.449577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.458384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 615/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:55.464656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869b2cd-22f9-4ad3-af9f-33d49430df9d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.573780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869b2cd-22f9-4ad3-af9f-33d49430df9d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.609197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.610097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.610396 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.610670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.622672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.624241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:55.642083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:55.643090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:55.644012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:55.644012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:55.644012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:55.644012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:34:55.644012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 595/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:55.649634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.758587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c2a84-b990-4f95-b69f-2f8bc6c4b92c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.798428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.799176 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.799496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.799771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.800566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:55.800913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.802459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.816468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 616/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:55.822130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.941185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adeb2b-b5b7-411c-90ef-0f6545d8a5f1 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.977778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.978603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.978869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.979164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.987254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.988708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:56.007407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:56.008604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:34:56.009570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 596/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:56.015028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.128435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dd2a9-3bac-4b36-88a5-6de288250c16 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.167217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.167943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.168211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.168474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.169461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:56.169780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.171473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.190074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 617/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:56.196147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.307742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd2f4d-c42b-4ed3-b982-e000dd2ac9c6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.343610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70151e36-43d0-4487-afd0-fe2751740cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.344260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70151e36-43d0-4487-afd0-fe2751740cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.344537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70151e36-43d0-4487-afd0-fe2751740cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.344809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70151e36-43d0-4487-afd0-fe2751740cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.413781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70151e36-43d0-4487-afd0-fe2751740cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.416397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70151e36-43d0-4487-afd0-fe2751740cd6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.520893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 597/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:34:56.527054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.635598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3a0e-5a6c-489b-ab4f-66d99209eac1 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.674385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.675221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.675508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.675786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.686693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.688176 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:56.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:56.707054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:56.707960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:56.707960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:56.707960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:56.707960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:34:56.707960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 618/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:56.713662 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70151e36-43d0-4487-afd0-fe2751740cd6 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.812649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70151e36-43d0-4487-afd0-fe2751740cd6 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.846498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.847204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.847490 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.847764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.848485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:56.848796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.850159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.867973 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 598/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:56.869523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.973162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a37c77-a651-406c-815c-2e8b137b67c3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.008619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:57.009492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.009796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.010066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.017507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:57.019080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:57.034380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:57.035399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:34:57.036307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 619/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:57.041707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:57.150875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d158c5-7fc4-4867-8bb7-92431e41193d None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.194528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd59aa0-64b5-414e-be97-3f02fee3103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:57.196041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd59aa0-64b5-414e-be97-3f02fee3103f None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.196165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd59aa0-64b5-414e-be97-3f02fee3103f None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.196358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd59aa0-64b5-414e-be97-3f02fee3103f None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.197147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd59aa0-64b5-414e-be97-3f02fee3103f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:57.197503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd59aa0-64b5-414e-be97-3f02fee3103f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:57.199123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd59aa0-64b5-414e-be97-3f02fee3103f None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:57.214935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 599/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:57.221471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:57.330989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1918c7-7f62-40e1-85ff-7b03b05f813d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.371744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81b396-2927-496a-afe7-a864076315c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:57.372419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81b396-2927-496a-afe7-a864076315c2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.372710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81b396-2927-496a-afe7-a864076315c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.372989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81b396-2927-496a-afe7-a864076315c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.373933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81b396-2927-496a-afe7-a864076315c2 None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=63ed36df893640fc929d7953751d1116) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:57.374253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81b396-2927-496a-afe7-a864076315c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:57.375763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81b396-2927-496a-afe7-a864076315c2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:57.382044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 620/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:34:57 2022] GET /identity/v3/role_assignments?user.id=63ed36df893640fc929d7953751d1116&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:59.638624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859ed0-31a7-44bc-936e-a9605fe2849b None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.639224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859ed0-31a7-44bc-936e-a9605fe2849b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.639224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6859ed0-31a7-44bc-936e-a9605fe2849b None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.640724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 600/1220] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:59.645635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454c080-f538-47fe-8e2d-d1b2a47b7546 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.646038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454c080-f538-47fe-8e2d-d1b2a47b7546 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.646197 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454c080-f538-47fe-8e2d-d1b2a47b7546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.663628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1454c080-f538-47fe-8e2d-d1b2a47b7546 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:59.665404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1454c080-f538-47fe-8e2d-d1b2a47b7546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:59.741230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 621/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:34:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:34:59.764937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6859ed0-31a7-44bc-936e-a9605fe2849b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.879111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6859ed0-31a7-44bc-936e-a9605fe2849b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:59.919850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595f300-d91f-4e5e-b112-191212f37877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:59.920847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f300-d91f-4e5e-b112-191212f37877 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.921143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f300-d91f-4e5e-b112-191212f37877 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.921400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f300-d91f-4e5e-b112-191212f37877 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.931832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595f300-d91f-4e5e-b112-191212f37877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-3595f300-d91f-4e5e-b112-191212f37877 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:59.939637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:59.940582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:34:59.941479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 601/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:59.947741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454c080-f538-47fe-8e2d-d1b2a47b7546 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.057310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454c080-f538-47fe-8e2d-d1b2a47b7546 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.101074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.102123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.102544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.102931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.103954 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] RBAC: Adding query filter params (name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:00.104262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.106161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.116380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 622/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:00.122415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595f300-d91f-4e5e-b112-191212f37877 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.234133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595f300-d91f-4e5e-b112-191212f37877 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.274699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.275554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.275863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.276161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.289800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.291470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:00.310637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:00.311824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:00.312823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:00.312823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:00.312823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:00.312823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:00.312823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 602/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:00.317787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.430922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d9922-23c3-41a0-9cd2-eac38a044c9d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.467366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.468029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.468316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.468673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.469457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:00.469835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.471437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.484409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 623/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:00.490102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.595931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513d9df-8a3f-449b-bc18-ed94cf6b9506 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.630229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.631060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.631346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.631647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.640243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.641718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:00.659515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:00.660698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:00.661864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:00.667296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 603/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:00.667432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.774240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf695de-f14b-4923-8c1f-197ab61d2182 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.810319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.810885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.811194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.811467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.812305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:00.812609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.814022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.832003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 624/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:00.837932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.947528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c55f2f-e43d-4bd4-a4c7-10fc5a8d0c7b None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.981683 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.982722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.983037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.983315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.994414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.995982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:01.015945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:01.017073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:01.018166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:01.018166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:01.018166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:01.018166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:01.018166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 604/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:01.023958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.132629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddb88a-f126-44d4-8c11-d5ac77b38f54 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.172481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.173146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.173429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.173703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.174424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:01.174728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.176273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.189633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 625/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:01.195819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.315620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc82b0-a785-4691-911a-e609769d6e2c None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.352704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.353498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.353788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.354064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.361077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.362516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:01.376472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:01.377597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:01.378526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 605/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:01.384052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.492238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b86e6d-83ce-49c3-982b-90010911d28b None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.530742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb1a0c-57f0-4ef2-900c-dd5e0dd08c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.531488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1a0c-57f0-4ef2-900c-dd5e0dd08c73 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.531780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1a0c-57f0-4ef2-900c-dd5e0dd08c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.532053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1a0c-57f0-4ef2-900c-dd5e0dd08c73 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.532890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb1a0c-57f0-4ef2-900c-dd5e0dd08c73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:01.533242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb1a0c-57f0-4ef2-900c-dd5e0dd08c73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.534664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb1a0c-57f0-4ef2-900c-dd5e0dd08c73 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.547203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 626/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:01.553880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.658705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63325811-57f8-4d1e-aa4f-66b098d6da62 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.693736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de44b6e-1d06-47cd-a118-b9a5c90f746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.694663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de44b6e-1d06-47cd-a118-b9a5c90f746d None admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.694929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de44b6e-1d06-47cd-a118-b9a5c90f746d None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.695733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de44b6e-1d06-47cd-a118-b9a5c90f746d None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/63ed36df893640fc929d7953751d1116/roles/03a8445ffd574dc38f0948d45ce527b7` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.710808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de44b6e-1d06-47cd-a118-b9a5c90f746d None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=63ed36df893640fc929d7953751d1116, role_id=03a8445ffd574dc38f0948d45ce527b7)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.712926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de44b6e-1d06-47cd-a118-b9a5c90f746d None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.725230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 606/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:35:01 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/63ed36df893640fc929d7953751d1116/roles/03a8445ffd574dc38f0948d45ce527b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:35:03.958649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c55e-c79d-473f-acb8-3bf2c5294972 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.959339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c55e-c79d-473f-acb8-3bf2c5294972 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.959483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c55e-c79d-473f-acb8-3bf2c5294972 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.960855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 627/1233] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:03.966999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15848-6785-4e90-8ba9-507044523967 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.967474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15848-6785-4e90-8ba9-507044523967 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.967770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15848-6785-4e90-8ba9-507044523967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.987532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3af15848-6785-4e90-8ba9-507044523967 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:03.988699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3af15848-6785-4e90-8ba9-507044523967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:04.065343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 607/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:35:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:04.094150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94c55e-c79d-473f-acb8-3bf2c5294972 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.203929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94c55e-c79d-473f-acb8-3bf2c5294972 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.246501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e549-791c-4a2d-82fa-ccf785ea7191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.247339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e549-791c-4a2d-82fa-ccf785ea7191 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.247625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e549-791c-4a2d-82fa-ccf785ea7191 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.247886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e549-791c-4a2d-82fa-ccf785ea7191 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.258829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96e549-791c-4a2d-82fa-ccf785ea7191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-5e96e549-791c-4a2d-82fa-ccf785ea7191 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:04.266668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:04.267931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:04.269081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 628/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:04.273865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15848-6785-4e90-8ba9-507044523967 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.381469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15848-6785-4e90-8ba9-507044523967 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.424183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.425199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.425829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.426288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.427197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] RBAC: Adding query filter params (name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:04.427505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.428888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.438875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 608/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:04.444355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e549-791c-4a2d-82fa-ccf785ea7191 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.547970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e549-791c-4a2d-82fa-ccf785ea7191 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.584587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.585510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.585787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.586185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.598739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.600309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:04.620398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:04.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:04.622552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:04.622552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:04.622552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:04.622552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:04.622552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 629/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:04.627712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.739239 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5dbe9-4e2a-48ed-969b-3448f9605630 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.778218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.779182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.779631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.779916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.780644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:04.780949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.782306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.797174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 609/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:04.803445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.916156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c100b-fc41-4b8d-81fb-7a3f8916c988 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.954918 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.955757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.956100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.956307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.964578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.966033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:04.981138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:04.982468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:04.983625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 630/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:04.990072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.099461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25fb37-8817-4bef-a522-70f9ee5f3091 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.132411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.133594 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.133865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.134167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.134995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:05.135299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.136710 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.154735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 610/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:05.161011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.278955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b6f80-8e20-46fe-a49d-529a10db4e97 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.312882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3083-ed90-43b3-987d-ccf1a59b8897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.313761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3083-ed90-43b3-987d-ccf1a59b8897 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.313976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3083-ed90-43b3-987d-ccf1a59b8897 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.314312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3083-ed90-43b3-987d-ccf1a59b8897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.392496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e3083-ed90-43b3-987d-ccf1a59b8897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.394165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e3083-ed90-43b3-987d-ccf1a59b8897 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.521422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 631/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:35:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 16:35:05.527945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.637015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc48a-0259-4e92-b05e-b2490fe889e9 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.674586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.675386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.675723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.676054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.686834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.688296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:05.706517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:05.707611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:05.708506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:05.708506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:05.708506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:05.708506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:05.708506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 611/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:05.713856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3083-ed90-43b3-987d-ccf1a59b8897 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.817377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3083-ed90-43b3-987d-ccf1a59b8897 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.854366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.855264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.855537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.855845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.856787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:05.857120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.858808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.873432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 632/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:05.879251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.991328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5f398-ae93-43be-81da-b22cf771ab6b None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.025125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.025898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.026172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.026446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.033118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:06.034559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:06.048852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:06.050331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:06.051280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 612/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:35:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:06.056828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.162283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aae756-dabb-4d0f-a780-df7a1dc9990c None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.197938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d5d53-a0d5-4665-9470-d36e83090591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.198666 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5d53-a0d5-4665-9470-d36e83090591 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.198981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5d53-a0d5-4665-9470-d36e83090591 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.199261 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d5d53-a0d5-4665-9470-d36e83090591 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.200124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d5d53-a0d5-4665-9470-d36e83090591 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:06.200447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d5d53-a0d5-4665-9470-d36e83090591 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:06.202115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d5d53-a0d5-4665-9470-d36e83090591 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:06.214955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 633/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:06.222324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.339803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3842f-d865-480d-8d78-19981e05fb50 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.376062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329777e-0b14-4585-847d-788bdaf59877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.376756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329777e-0b14-4585-847d-788bdaf59877 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.377134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329777e-0b14-4585-847d-788bdaf59877 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.377466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329777e-0b14-4585-847d-788bdaf59877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.378370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329777e-0b14-4585-847d-788bdaf59877 None admin] RBAC: Adding query filter params (role.id=03a8445ffd574dc38f0948d45ce527b7, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=63ed36df893640fc929d7953751d1116) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:06.378713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329777e-0b14-4585-847d-788bdaf59877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:06.380324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329777e-0b14-4585-847d-788bdaf59877 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:06.387090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 613/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/role_assignments?user.id=63ed36df893640fc929d7953751d1116&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=03a8445ffd574dc38f0948d45ce527b7 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:08.910918 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432939-9655-4d0b-802e-2be50c451cf7 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.911547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432939-9655-4d0b-802e-2be50c451cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.911547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432939-9655-4d0b-802e-2be50c451cf7 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.912927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 634/1247] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:08.918747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfa73-0304-447f-9418-11ed7f265928 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.919237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfa73-0304-447f-9418-11ed7f265928 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.919345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfa73-0304-447f-9418-11ed7f265928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.936250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-dd3bfa73-0304-447f-9418-11ed7f265928 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:08.937433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-dd3bfa73-0304-447f-9418-11ed7f265928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:09.010627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 614/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:09.035865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8432939-9655-4d0b-802e-2be50c451cf7 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.142925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8432939-9655-4d0b-802e-2be50c451cf7 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.181365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb56249-a5e0-4b01-84b0-42d69484dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.182156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56249-a5e0-4b01-84b0-42d69484dbcb None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.182438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56249-a5e0-4b01-84b0-42d69484dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.182707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56249-a5e0-4b01-84b0-42d69484dbcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.194621 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb56249-a5e0-4b01-84b0-42d69484dbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-bdb56249-a5e0-4b01-84b0-42d69484dbcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:09.204718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:09.206195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:09.207758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 635/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:09.213549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bfa73-0304-447f-9418-11ed7f265928 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.342320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bfa73-0304-447f-9418-11ed7f265928 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.378095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.378755 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.379059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.379334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.380073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:09.380373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.381734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.390694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 615/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:09.396302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb56249-a5e0-4b01-84b0-42d69484dbcb None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.501150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb56249-a5e0-4b01-84b0-42d69484dbcb None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.536197 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.537028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.537391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.537648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.550110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.551762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:09.573099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:09.574626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:09.576099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:09.576099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:09.576099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:09.576099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:09.576099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 636/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:09.580237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.681438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3816f9-abe6-4881-a96e-91f5ef9bfbc3 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.715471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.716797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.717077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.717355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.718078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:09.718397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.719817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.734620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 616/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:09.740076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.853684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3976484-e27b-4b3f-a3b0-e77406d52d20 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.892556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.893372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.893735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.893927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.902013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.903742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:09.920801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:09.922387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:09.923584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 637/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:09.927875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.037439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642b939-7846-402a-b17d-0e4fd4b17575 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.072342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.073005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.073283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.073552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.074383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:10.074685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.076125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.093797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 617/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:10.099743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.205844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee3f2f-240e-4c00-b133-ebf79f632631 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.247462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b04efc-7a6f-446a-b6d4-0eac414268d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.248277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b04efc-7a6f-446a-b6d4-0eac414268d2 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.248685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b04efc-7a6f-446a-b6d4-0eac414268d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.248972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b04efc-7a6f-446a-b6d4-0eac414268d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.319392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b04efc-7a6f-446a-b6d4-0eac414268d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.320856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b04efc-7a6f-446a-b6d4-0eac414268d2 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.421228 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 638/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:10.427200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.530169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8e8fe-eae7-4e36-8796-2388242a4d40 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.565737 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.566642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.567026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.567315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.578582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.579981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:10.602247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:10.603324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:10.604272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:10.604272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:10.604272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:10.604272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:10.604272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 618/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:10.611037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b04efc-7a6f-446a-b6d4-0eac414268d2 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.714313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b04efc-7a6f-446a-b6d4-0eac414268d2 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.751857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.752534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.752815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.753089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.753831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:10.754141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.755588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.773670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 639/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:10.774695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.882272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f9070-aedd-4e51-ae80-06fdbcb30a89 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.918360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.919193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.919476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.919751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.927319 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.928788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:10.944042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:10.945847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:10.951869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 619/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:10.952509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.052744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6da5d-d6fa-44d4-9c45-cd96f8d47a42 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.086842 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a09f07-d483-4212-b997-704388f571b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.087556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09f07-d483-4212-b997-704388f571b6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.087838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09f07-d483-4212-b997-704388f571b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.088118 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a09f07-d483-4212-b997-704388f571b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.088907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a09f07-d483-4212-b997-704388f571b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:11.089217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a09f07-d483-4212-b997-704388f571b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.090639 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a09f07-d483-4212-b997-704388f571b6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.103253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 640/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:11.109410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.210852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476360bd-65c6-49c4-b4a1-cdb498c06b14 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.253107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d296e0-1cd6-416c-af6b-0f9218eee551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.253774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d296e0-1cd6-416c-af6b-0f9218eee551 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.254057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d296e0-1cd6-416c-af6b-0f9218eee551 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.254338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d296e0-1cd6-416c-af6b-0f9218eee551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.255255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d296e0-1cd6-416c-af6b-0f9218eee551 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=63ed36df893640fc929d7953751d1116) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:11.255569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d296e0-1cd6-416c-af6b-0f9218eee551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.257012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d296e0-1cd6-416c-af6b-0f9218eee551 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.262891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 620/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/role_assignments?user.id=63ed36df893640fc929d7953751d1116&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:13.443915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa075497-8e3b-4b90-b4db-30172519e8c8 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.444477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa075497-8e3b-4b90-b4db-30172519e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.444477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa075497-8e3b-4b90-b4db-30172519e8c8 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.446456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 641/1261] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:13.451510 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c1ce-1d4d-467f-a4cc-447509bf9e78 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.451950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c1ce-1d4d-467f-a4cc-447509bf9e78 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.452052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c1ce-1d4d-467f-a4cc-447509bf9e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.468673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-68b3c1ce-1d4d-467f-a4cc-447509bf9e78 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:13.469825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-68b3c1ce-1d4d-467f-a4cc-447509bf9e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:13.531073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 621/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:35:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:13.552946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa075497-8e3b-4b90-b4db-30172519e8c8 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.646304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa075497-8e3b-4b90-b4db-30172519e8c8 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.677727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855abbb-30e1-467e-9a24-695d43459f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.678493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855abbb-30e1-467e-9a24-695d43459f25 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.678769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855abbb-30e1-467e-9a24-695d43459f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.679062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855abbb-30e1-467e-9a24-695d43459f25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.688506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855abbb-30e1-467e-9a24-695d43459f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-c855abbb-30e1-467e-9a24-695d43459f25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:13.696865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:13.698096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:13.699324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 642/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:13.704010 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3c1ce-1d4d-467f-a4cc-447509bf9e78 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.797071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3c1ce-1d4d-467f-a4cc-447509bf9e78 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.829005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.829650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.829941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.830226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.830971 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:13.831287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.832642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.840198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 622/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:13.845955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855abbb-30e1-467e-9a24-695d43459f25 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.939009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855abbb-30e1-467e-9a24-695d43459f25 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.969977 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.970675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.970952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.971248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.980994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.982436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:13.999200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:14.000270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:14.001531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:14.001531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:14.001531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:14.001531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:14.001531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 643/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:14.006098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.099369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17b5ea-bd7f-49ac-af8d-e05a2e4539aa None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.130564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.131226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.131503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.131768 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.132499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:14.132800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.134143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.144999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 623/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:14.150650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.251514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23097b-9d24-4d5e-9451-cc2aa3e166fc None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.284239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.285033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.285311 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.285581 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.293244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.294661 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:14.309325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:14.310408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:14.311561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 644/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:14.316226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.408399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0631c29-1bf5-4be9-89a8-5d2f4aecfac5 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.441899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.442554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.442838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.443144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.443980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:14.444286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.445741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.462413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 624/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:14.468050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.561649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfd65c-1597-4b2e-a693-667d962b5c0e None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.596771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.597551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.597829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.598099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.610154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.611605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:14.627734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:14.628781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:14.629885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:14.629885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:14.629885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:14.629885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:14.629885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 645/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:14.634711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.732363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef83da-b6bd-4dfa-8957-0f0684a4a856 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.771011 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.771667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.771946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.772222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.773490 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:14.773795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.775190 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.786357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 625/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:14.792756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.897248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2970-25cb-4efb-b85c-2910ee2e4de3 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.932882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.933663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.933939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.934214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.940674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.942090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:14.958253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:14.960285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:14.961928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 646/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:14.965911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:15.061985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad249-ff73-4380-91fd-3fa0add2780b None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.095070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172023f1-e02b-4e46-a966-cde3a21dbf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.095720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172023f1-e02b-4e46-a966-cde3a21dbf0e None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.095999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172023f1-e02b-4e46-a966-cde3a21dbf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.096270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172023f1-e02b-4e46-a966-cde3a21dbf0e None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.097139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172023f1-e02b-4e46-a966-cde3a21dbf0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:15.097646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172023f1-e02b-4e46-a966-cde3a21dbf0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.099856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172023f1-e02b-4e46-a966-cde3a21dbf0e None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.112942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 626/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:15.118981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:15.221907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d0b5-c19b-480e-b301-dc308e3183be None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.264450 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159fe2f-f37b-4f3d-bb50-071130d3179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.265323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159fe2f-f37b-4f3d-bb50-071130d3179a None admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.265596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159fe2f-f37b-4f3d-bb50-071130d3179a None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.265863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159fe2f-f37b-4f3d-bb50-071130d3179a None admin] PATH_INFO: `/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/63ed36df893640fc929d7953751d1116/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.267797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159fe2f-f37b-4f3d-bb50-071130d3179a None admin] RBAC: Authorizing `identity:create_grant(project_id=45c3d9e5ea5b45f98e7c48a87e60905e, user_id=63ed36df893640fc929d7953751d1116, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.269333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159fe2f-f37b-4f3d-bb50-071130d3179a None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.284980 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 647/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 16:35:15 2022] PUT /identity/v3/projects/45c3d9e5ea5b45f98e7c48a87e60905e/users/63ed36df893640fc929d7953751d1116/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:35:17.480791 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac0074-31e1-4c4d-af45-96c4b59e0f56 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.481355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac0074-31e1-4c4d-af45-96c4b59e0f56 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.481355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac0074-31e1-4c4d-af45-96c4b59e0f56 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.482690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 627/1274] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:17.487927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1d54-8bcf-4987-978c-fdf689dadcc0 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.488362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1d54-8bcf-4987-978c-fdf689dadcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.488487 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1d54-8bcf-4987-978c-fdf689dadcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.505096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ceec1d54-8bcf-4987-978c-fdf689dadcc0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:17.506270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ceec1d54-8bcf-4987-978c-fdf689dadcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:17.568850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 648/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:35:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:17.592031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac0074-31e1-4c4d-af45-96c4b59e0f56 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.686531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac0074-31e1-4c4d-af45-96c4b59e0f56 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.717662 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c07b-29cd-4777-8497-0010ffc50e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.718440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c07b-29cd-4777-8497-0010ffc50e77 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.718712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c07b-29cd-4777-8497-0010ffc50e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.718994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c07b-29cd-4777-8497-0010ffc50e77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.728963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6c07b-29cd-4777-8497-0010ffc50e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-a0d6c07b-29cd-4777-8497-0010ffc50e77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:17.736555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:17.737648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:17.738688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 628/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 16:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:17.743365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec1d54-8bcf-4987-978c-fdf689dadcc0 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.834264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec1d54-8bcf-4987-978c-fdf689dadcc0 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.866710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.867391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.867672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.867943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.868681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:17.868981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:17.870332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:17.878010 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 649/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 16:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:17.884402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c07b-29cd-4777-8497-0010ffc50e77 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.977587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c07b-29cd-4777-8497-0010ffc50e77 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.008586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.009293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.009569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.009835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.019601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.021027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:18.037647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:18.038663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:18.039650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:18.039650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:18.039650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:18.039650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:18.039650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 629/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:18.044532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.142819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894d8cb-cf58-442d-aa04-0a71bf1a0531 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.174439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.175128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.175413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.175690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.176407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:18.176716 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.178069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.189760 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 650/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:18.195990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.300496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f4fb7-8769-4fe6-b65f-d924c5f50078 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.332027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.332801 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.333075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.333343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.340317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.341733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:18.355526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:18.356610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:18.357786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 630/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:18.362524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.455734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28972c-1ebf-4422-b56e-8834128216ae None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.486514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.487180 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.487457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.487724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.488540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:18.489072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.490231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.506397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 651/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:18.512459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.604709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23ff5-7107-49e5-bf0d-2c99f434c145 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.635212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b28a0-85bd-4ce5-9daa-d975b9f25f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.635826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b28a0-85bd-4ce5-9daa-d975b9f25f0a None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.636107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b28a0-85bd-4ce5-9daa-d975b9f25f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.636378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b28a0-85bd-4ce5-9daa-d975b9f25f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.697621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b28a0-85bd-4ce5-9daa-d975b9f25f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.699064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b28a0-85bd-4ce5-9daa-d975b9f25f0a None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.787646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 631/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:18.793658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.888195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c354b-6b97-44bc-829f-39c385090513 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.920070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.921115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.921393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.921663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.931623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.933104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:18.953209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:18.954287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:18.955488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:18.955488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:18.955488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:18.955488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:18.955488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 652/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:18.959999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b28a0-85bd-4ce5-9daa-d975b9f25f0a None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:19.052106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b28a0-85bd-4ce5-9daa-d975b9f25f0a None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:19.082955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:19.083620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:19.083904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:19.084177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:19.084888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:19.085193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:19.087069 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:19.097523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 632/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:19.103428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:19.195641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1682-b06f-4e63-afc8-72a9076f718d None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:19.231092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:19.231880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:19.232161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:19.232436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:19.238754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:19.240211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:19.253708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application with Lock( May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:19.254735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: ERROR keystone.server.flask.application May 10 16:35:19.255832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 653/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 16:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:19.260679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:19.353656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7aa1c-a9a2-43ef-bfa2-7743afd7ab54 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:19.384286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2e661-4a08-4237-a5c1-cacadfd14cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:19.384917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2e661-4a08-4237-a5c1-cacadfd14cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:19.385194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2e661-4a08-4237-a5c1-cacadfd14cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:19.385465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2e661-4a08-4237-a5c1-cacadfd14cd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:19.386237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2e661-4a08-4237-a5c1-cacadfd14cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:19.386539 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2e661-4a08-4237-a5c1-cacadfd14cd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:19.387974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2e661-4a08-4237-a5c1-cacadfd14cd6 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:19.399592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 633/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 16:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:19.405310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:19.497916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bfb49-6811-4f5a-9cf1-a212ef925bf6 None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:19.529477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6df3bc-02ce-4be3-9dfb-93299acf8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:19.530105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6df3bc-02ce-4be3-9dfb-93299acf8e34 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:19.530391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6df3bc-02ce-4be3-9dfb-93299acf8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:19.530664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6df3bc-02ce-4be3-9dfb-93299acf8e34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:19.531502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6df3bc-02ce-4be3-9dfb-93299acf8e34 None admin] RBAC: Adding query filter params (role.id=90029ab98d9d4f11bd1b3f77fad73c84, scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e, user.id=63ed36df893640fc929d7953751d1116) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:19.531811 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6df3bc-02ce-4be3-9dfb-93299acf8e34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:19.533210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6df3bc-02ce-4be3-9dfb-93299acf8e34 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:19.538710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 654/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 16:35:19 2022] GET /identity/v3/role_assignments?user.id=63ed36df893640fc929d7953751d1116&scope.project.id=45c3d9e5ea5b45f98e7c48a87e60905e&role.id=90029ab98d9d4f11bd1b3f77fad73c84 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:21.760578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b03d-5027-4c37-91f2-870d02276a96 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.761139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b03d-5027-4c37-91f2-870d02276a96 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.761139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b03d-5027-4c37-91f2-870d02276a96 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.762465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 634/1288] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:21.767589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4a08-02a4-4cec-9322-23803958f0f9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.768021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4a08-02a4-4cec-9322-23803958f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.768147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4a08-02a4-4cec-9322-23803958f0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.784253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-84ea4a08-02a4-4cec-9322-23803958f0f9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:21.785417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-84ea4a08-02a4-4cec-9322-23803958f0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:21.847972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 655/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:35:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:21.870404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b03d-5027-4c37-91f2-870d02276a96 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:21.968228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b03d-5027-4c37-91f2-870d02276a96 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.999817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.000603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.000879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:22.001147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:22.001784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:22.003161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:22.014554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:22.015770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:22.016654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 635/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:35:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:22.021698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4a08-02a4-4cec-9322-23803958f0f9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:22.116898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4a08-02a4-4cec-9322-23803958f0f9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:22.148870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed4a04-5503-4328-8678-74efd8746c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.149523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed4a04-5503-4328-8678-74efd8746c3f None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.149806 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed4a04-5503-4328-8678-74efd8746c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:22.150080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed4a04-5503-4328-8678-74efd8746c3f None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:22.150782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed4a04-5503-4328-8678-74efd8746c3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:22.151128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed4a04-5503-4328-8678-74efd8746c3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:22.152472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed4a04-5503-4328-8678-74efd8746c3f None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:22.157073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 656/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Tue May 10 16:35:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:22.162776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:22.270454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9bf27-0842-4f88-a579-f870013d5e53 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:22.304107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492d777-0b95-4ece-9a66-702dd6832653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.304761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492d777-0b95-4ece-9a66-702dd6832653 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.305037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492d777-0b95-4ece-9a66-702dd6832653 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:22.305306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492d777-0b95-4ece-9a66-702dd6832653 None admin] PATH_INFO: `/v3/services` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:22.306000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492d777-0b95-4ece-9a66-702dd6832653 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:22.306299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492d777-0b95-4ece-9a66-702dd6832653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:22.307689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492d777-0b95-4ece-9a66-702dd6832653 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:22.311876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 636/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Tue May 10 16:35:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:24.522523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566fcf-9cd5-41a9-8e2e-8bb719acc9ad None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.523082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566fcf-9cd5-41a9-8e2e-8bb719acc9ad None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.523082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566fcf-9cd5-41a9-8e2e-8bb719acc9ad None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.524531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 657/1293] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:24.529866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767adfac-b7a5-4cf9-8fcc-105b05f41ad6 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.530313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767adfac-b7a5-4cf9-8fcc-105b05f41ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.530409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767adfac-b7a5-4cf9-8fcc-105b05f41ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.546672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-767adfac-b7a5-4cf9-8fcc-105b05f41ad6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:24.547866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-767adfac-b7a5-4cf9-8fcc-105b05f41ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:24.609507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 637/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:35:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:24.632088 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62566fcf-9cd5-41a9-8e2e-8bb719acc9ad None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.727757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62566fcf-9cd5-41a9-8e2e-8bb719acc9ad None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.759700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ce27a-c958-4182-94c0-f146c34541ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.760344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ce27a-c958-4182-94c0-f146c34541ae None admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.760628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ce27a-c958-4182-94c0-f146c34541ae None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.760990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ce27a-c958-4182-94c0-f146c34541ae None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.761720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ce27a-c958-4182-94c0-f146c34541ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.763103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ce27a-c958-4182-94c0-f146c34541ae None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.775781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 658/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 16:35:24 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:26.962817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66b55-bdb2-4cbf-bfaf-86e6bb8b8a67 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.963320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66b55-bdb2-4cbf-bfaf-86e6bb8b8a67 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.963409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66b55-bdb2-4cbf-bfaf-86e6bb8b8a67 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.964781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 638/1296] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:26.969872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e833f3-d5aa-400f-971f-9c536909836e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.970279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e833f3-d5aa-400f-971f-9c536909836e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.970414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e833f3-d5aa-400f-971f-9c536909836e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.986406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-61e833f3-d5aa-400f-971f-9c536909836e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:26.987590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-61e833f3-d5aa-400f-971f-9c536909836e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:27.054743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 659/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:35:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:27.076888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66b55-bdb2-4cbf-bfaf-86e6bb8b8a67 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.170700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66b55-bdb2-4cbf-bfaf-86e6bb8b8a67 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.202254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.203459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.203840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.204190 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.204952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.206897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:27.220345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:27.221530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:27.222578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 639/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:27.227474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e833f3-d5aa-400f-971f-9c536909836e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.318751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e833f3-d5aa-400f-971f-9c536909836e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.350020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.350686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.350990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.351263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.351960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:27.352260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.353604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.358390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 660/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:27.364233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.458085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b343d55-1667-4c0e-8ec3-477ba0364984 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.488580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0199606-023a-4ef1-9d58-49b58b5b9cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.489208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0199606-023a-4ef1-9d58-49b58b5b9cdf None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.489483 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0199606-023a-4ef1-9d58-49b58b5b9cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.489752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0199606-023a-4ef1-9d58-49b58b5b9cdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.490528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0199606-023a-4ef1-9d58-49b58b5b9cdf None admin] RBAC: Adding query filter params (interface=public, service_id=86b05047581241b489be23a2228ea626, region_id=RegionOne) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:27.490834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0199606-023a-4ef1-9d58-49b58b5b9cdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.492733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0199606-023a-4ef1-9d58-49b58b5b9cdf None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.497430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 640/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/endpoints?service_id=86b05047581241b489be23a2228ea626&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:27.502726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.594261 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914bf03-457d-46a4-b798-1b9547df9f6b None admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.626072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a1eb0-3fb4-4024-8877-a8fbf1ba29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.626705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1eb0-3fb4-4024-8877-a8fbf1ba29b5 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.627001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1eb0-3fb4-4024-8877-a8fbf1ba29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.627275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1eb0-3fb4-4024-8877-a8fbf1ba29b5 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.627939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a1eb0-3fb4-4024-8877-a8fbf1ba29b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.629272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a1eb0-3fb4-4024-8877-a8fbf1ba29b5 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.635765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 661/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/services => generated 2191 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:35:29.816933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ccef-704f-45cf-a334-0e8ac1252806 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:29.817496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ccef-704f-45cf-a334-0e8ac1252806 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:29.817496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ccef-704f-45cf-a334-0e8ac1252806 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:29.818814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 641/1302] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:29.823918 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e274a-b5a9-4161-8439-8f9fbe6020fd None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:29.824326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e274a-b5a9-4161-8439-8f9fbe6020fd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:29.824469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e274a-b5a9-4161-8439-8f9fbe6020fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:29.841104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-617e274a-b5a9-4161-8439-8f9fbe6020fd None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:29.842285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-617e274a-b5a9-4161-8439-8f9fbe6020fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:29.905968 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 662/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:35:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:29.928141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435ccef-704f-45cf-a334-0e8ac1252806 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:30.022240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435ccef-704f-45cf-a334-0e8ac1252806 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:30.055695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:30.056465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.056739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.057006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.057639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:30.059006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:30.070954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:30.072146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application with Lock( May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: ERROR keystone.server.flask.application May 10 16:35:30.073279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 642/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 16:35:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:30.077996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e274a-b5a9-4161-8439-8f9fbe6020fd None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:30.172891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e274a-b5a9-4161-8439-8f9fbe6020fd None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:30.206223 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec5b99-6238-44aa-ba32-06396d766b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:30.207064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec5b99-6238-44aa-ba32-06396d766b16 None admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.207525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec5b99-6238-44aa-ba32-06396d766b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.207752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec5b99-6238-44aa-ba32-06396d766b16 None admin] PATH_INFO: `/v3/services` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.208588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec5b99-6238-44aa-ba32-06396d766b16 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:30.209022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec5b99-6238-44aa-ba32-06396d766b16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:30.211207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec5b99-6238-44aa-ba32-06396d766b16 None admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:30.217718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 663/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Tue May 10 16:35:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:30.223806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:30.318057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5f6a0-20f9-463f-be97-364c4e75ce04 None admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:30.348810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709009b-43d3-4b1c-b9d0-67583e56dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:30.349382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709009b-43d3-4b1c-b9d0-67583e56dfff None admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.349659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709009b-43d3-4b1c-b9d0-67583e56dfff None admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.349930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709009b-43d3-4b1c-b9d0-67583e56dfff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.350677 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709009b-43d3-4b1c-b9d0-67583e56dfff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:30.352066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709009b-43d3-4b1c-b9d0-67583e56dfff None admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:30.369089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 643/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 16:35:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:36:33.709547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339214c-cb40-40b9-be11-dee3de31de09 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:33.710036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339214c-cb40-40b9-be11-dee3de31de09 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:33.710117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339214c-cb40-40b9-be11-dee3de31de09 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:33.715746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 664/1307] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:33.717643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee877b5-2041-4434-8f4f-6c21beb22090 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:33.718763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee877b5-2041-4434-8f4f-6c21beb22090 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:33.719630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee877b5-2041-4434-8f4f-6c21beb22090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:33.813885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-eee877b5-2041-4434-8f4f-6c21beb22090 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:33.815119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-eee877b5-2041-4434-8f4f-6c21beb22090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:33.917009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 644/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:33.966700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0505be-a3f5-4284-82ea-bdbb1473e1c4 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:33.967016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0505be-a3f5-4284-82ea-bdbb1473e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:33.967362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0505be-a3f5-4284-82ea-bdbb1473e1c4 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:33.968750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 665/1309] 10.222.0.57 () {54 vars in 964 bytes} [Tue May 10 16:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:33.975921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208b4f-ca04-406f-8e82-9e7ec48c5143 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:33.976609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208b4f-ca04-406f-8e82-9e7ec48c5143 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:33.977088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208b4f-ca04-406f-8e82-9e7ec48c5143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.058478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-9e208b4f-ca04-406f-8e82-9e7ec48c5143 None None] MFA Rules not processed for user `05b1227b7f36498e8c1f1e27fa0ccb46`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:34.060063 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9e208b4f-ca04-406f-8e82-9e7ec48c5143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:34.138095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 645/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Tue May 10 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:34.147679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0505be-a3f5-4284-82ea-bdbb1473e1c4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:34.149405 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-dd0505be-a3f5-4284-82ea-bdbb1473e1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:34.260471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0505be-a3f5-4284-82ea-bdbb1473e1c4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:34.331363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de604c-69c1-4ed2-86ce-54e4e98d6a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:34.332007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de604c-69c1-4ed2-86ce-54e4e98d6a68 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:34.332285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de604c-69c1-4ed2-86ce-54e4e98d6a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:34.332554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de604c-69c1-4ed2-86ce-54e4e98d6a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.334754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-18de604c-69c1-4ed2-86ce-54e4e98d6a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:34.439847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de604c-69c1-4ed2-86ce-54e4e98d6a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:34.441208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de604c-69c1-4ed2-86ce-54e4e98d6a68 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:34.460194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 666/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:36:36.982480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d64f3-ca72-4eb9-99fd-754dec900924 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:36.983014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d64f3-ca72-4eb9-99fd-754dec900924 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:36.983099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d64f3-ca72-4eb9-99fd-754dec900924 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:36.984595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 646/1312] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:36.990446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f790-7cd9-47b7-bb07-6fb99b461623 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:36.990897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f790-7cd9-47b7-bb07-6fb99b461623 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:36.991023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f790-7cd9-47b7-bb07-6fb99b461623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.076473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-18f3f790-7cd9-47b7-bb07-6fb99b461623 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:37.078030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-18f3f790-7cd9-47b7-bb07-6fb99b461623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:37.192490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 667/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:37.231170 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d64f3-ca72-4eb9-99fd-754dec900924 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:37.232753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f83d64f3-ca72-4eb9-99fd-754dec900924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:37.344281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d64f3-ca72-4eb9-99fd-754dec900924 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:37.419957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321e2ca-ea16-49ec-8c0a-d983dd1fb42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:37.420941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321e2ca-ea16-49ec-8c0a-d983dd1fb42b service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:37.421276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321e2ca-ea16-49ec-8c0a-d983dd1fb42b service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:37.421611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321e2ca-ea16-49ec-8c0a-d983dd1fb42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.423320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f321e2ca-ea16-49ec-8c0a-d983dd1fb42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:37.529333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321e2ca-ea16-49ec-8c0a-d983dd1fb42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:37.530803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321e2ca-ea16-49ec-8c0a-d983dd1fb42b service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:37.549862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 647/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:36:40.109325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9b2d-298c-42b1-b004-7ac93a0ddfb5 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:40.109975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9b2d-298c-42b1-b004-7ac93a0ddfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:40.109975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9b2d-298c-42b1-b004-7ac93a0ddfb5 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:40.111257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 668/1315] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:40.118167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb41b8-7384-44c2-a2ff-ca51e1ae413e None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:40.118641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb41b8-7384-44c2-a2ff-ca51e1ae413e None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:40.118752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb41b8-7384-44c2-a2ff-ca51e1ae413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:40.180990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6bfb41b8-7384-44c2-a2ff-ca51e1ae413e None None] MFA Rules not processed for user `69d5ff830b14457f94f35b938ef50099`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:40.182181 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6bfb41b8-7384-44c2-a2ff-ca51e1ae413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:40.273810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 648/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:40.312079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf9b2d-298c-42b1-b004-7ac93a0ddfb5 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:40.313578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bcdf9b2d-298c-42b1-b004-7ac93a0ddfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:40.410600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf9b2d-298c-42b1-b004-7ac93a0ddfb5 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:40.478404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe49e2-6ebd-4e92-840e-0aa16bca41d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:40.482985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe49e2-6ebd-4e92-840e-0aa16bca41d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:40.482985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe49e2-6ebd-4e92-840e-0aa16bca41d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:40.482985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe49e2-6ebd-4e92-840e-0aa16bca41d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:40.482985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0ffe49e2-6ebd-4e92-840e-0aa16bca41d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:40.584869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe49e2-6ebd-4e92-840e-0aa16bca41d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:40.586300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe49e2-6ebd-4e92-840e-0aa16bca41d9 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:40.604028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 669/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:36:43.351686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dba381-9de4-4daf-b8aa-41255d6a5a0e None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:43.352300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dba381-9de4-4daf-b8aa-41255d6a5a0e None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:43.352300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dba381-9de4-4daf-b8aa-41255d6a5a0e None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:43.353614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 649/1318] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:43.358974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723a7e-e070-4ad1-8c30-19096a22331f None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:43.359426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723a7e-e070-4ad1-8c30-19096a22331f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:43.359535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723a7e-e070-4ad1-8c30-19096a22331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:43.422898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-90723a7e-e070-4ad1-8c30-19096a22331f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:43.424133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-90723a7e-e070-4ad1-8c30-19096a22331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:43.514796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 670/1319] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:43.568858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2ea52-a25b-448b-8866-9704747e97a8 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:43.569145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2ea52-a25b-448b-8866-9704747e97a8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:43.569425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2ea52-a25b-448b-8866-9704747e97a8 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:43.570793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 650/1320] 10.222.0.57 () {54 vars in 964 bytes} [Tue May 10 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:43.576649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5c0ac-842f-4b95-97e5-67f246e90131 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:43.576941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5c0ac-842f-4b95-97e5-67f246e90131 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:43.577221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5c0ac-842f-4b95-97e5-67f246e90131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:43.648641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-bbd5c0ac-842f-4b95-97e5-67f246e90131 None None] MFA Rules not processed for user `05b1227b7f36498e8c1f1e27fa0ccb46`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:43.649866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bbd5c0ac-842f-4b95-97e5-67f246e90131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:43.720678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 671/1321] 10.222.0.57 () {58 vars in 1061 bytes} [Tue May 10 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:43.730273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2ea52-a25b-448b-8866-9704747e97a8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:43.731829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-76f2ea52-a25b-448b-8866-9704747e97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:43.830048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2ea52-a25b-448b-8866-9704747e97a8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:43.900287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efff73-9bd2-4b8f-95c1-bf09cedc1390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:43.900931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efff73-9bd2-4b8f-95c1-bf09cedc1390 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:43.901213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efff73-9bd2-4b8f-95c1-bf09cedc1390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:43.901487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efff73-9bd2-4b8f-95c1-bf09cedc1390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:43.903142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-36efff73-9bd2-4b8f-95c1-bf09cedc1390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:44.005342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efff73-9bd2-4b8f-95c1-bf09cedc1390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:44.006782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efff73-9bd2-4b8f-95c1-bf09cedc1390 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:44.024391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 651/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:36:47.361304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7f7df-05d7-4d00-af06-1bbce0306281 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:47.361850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7f7df-05d7-4d00-af06-1bbce0306281 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:47.361850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7f7df-05d7-4d00-af06-1bbce0306281 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:47.363436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 672/1323] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:47.368976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a02a-a2da-447f-aac9-71504a094180 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:47.369427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a02a-a2da-447f-aac9-71504a094180 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:47.369524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a02a-a2da-447f-aac9-71504a094180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:47.431535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-dfb9a02a-a2da-447f-aac9-71504a094180 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:47.432730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-dfb9a02a-a2da-447f-aac9-71504a094180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:47.523093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 652/1324] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:47.560308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7f7df-05d7-4d00-af06-1bbce0306281 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:47.561882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-04c7f7df-05d7-4d00-af06-1bbce0306281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:47.661936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7f7df-05d7-4d00-af06-1bbce0306281 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:47.733632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960f6a-a6dd-4b4c-a1d4-e4c3b4b2c083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:47.734274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960f6a-a6dd-4b4c-a1d4-e4c3b4b2c083 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:47.734555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960f6a-a6dd-4b4c-a1d4-e4c3b4b2c083 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:47.734827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960f6a-a6dd-4b4c-a1d4-e4c3b4b2c083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:47.736489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d5960f6a-a6dd-4b4c-a1d4-e4c3b4b2c083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:47.842167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5960f6a-a6dd-4b4c-a1d4-e4c3b4b2c083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:47.843661 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5960f6a-a6dd-4b4c-a1d4-e4c3b4b2c083 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:47.862559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 673/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:36:50.133597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12916e2d-4b74-484f-b9ed-3e4b1d826f91 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:50.134110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12916e2d-4b74-484f-b9ed-3e4b1d826f91 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:50.134110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12916e2d-4b74-484f-b9ed-3e4b1d826f91 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:50.135451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 653/1326] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:50.140544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34e39-982c-4d8f-b800-0328becfad46 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:50.140965 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34e39-982c-4d8f-b800-0328becfad46 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:50.141118 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34e39-982c-4d8f-b800-0328becfad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:50.203405 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-99b34e39-982c-4d8f-b800-0328becfad46 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:50.204616 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-99b34e39-982c-4d8f-b800-0328becfad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:50.298272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 674/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:36:50.333960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12916e2d-4b74-484f-b9ed-3e4b1d826f91 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:50.335567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-12916e2d-4b74-484f-b9ed-3e4b1d826f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:50.434531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12916e2d-4b74-484f-b9ed-3e4b1d826f91 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:50.504537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0c0cc-77b1-444e-8bf1-55429017857e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:50.505775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c0cc-77b1-444e-8bf1-55429017857e service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:50.506054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c0cc-77b1-444e-8bf1-55429017857e service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:50.506327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c0cc-77b1-444e-8bf1-55429017857e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:50.507966 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d9c0c0cc-77b1-444e-8bf1-55429017857e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:50.611906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0c0cc-77b1-444e-8bf1-55429017857e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:50.613332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0c0cc-77b1-444e-8bf1-55429017857e service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:50.630945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 654/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:36:52.902751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49370e-9c8f-4ed1-96e8-08defdbf75e3 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:52.903376 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49370e-9c8f-4ed1-96e8-08defdbf75e3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:52.903376 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49370e-9c8f-4ed1-96e8-08defdbf75e3 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:52.904698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 675/1329] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:52.910073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105db3c8-d596-4c6b-90ef-f71ad2631dec None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:52.910521 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105db3c8-d596-4c6b-90ef-f71ad2631dec None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:52.910637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105db3c8-d596-4c6b-90ef-f71ad2631dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:52.974875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-105db3c8-d596-4c6b-90ef-f71ad2631dec None None] MFA Rules not processed for user `69d5ff830b14457f94f35b938ef50099`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:52.976160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-105db3c8-d596-4c6b-90ef-f71ad2631dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:53.068820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 655/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:53.104856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49370e-9c8f-4ed1-96e8-08defdbf75e3 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:53.106353 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6f49370e-9c8f-4ed1-96e8-08defdbf75e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:53.209210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49370e-9c8f-4ed1-96e8-08defdbf75e3 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:53.278985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9547128-982a-482c-8879-455c35a4df34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:53.279640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547128-982a-482c-8879-455c35a4df34 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:53.279926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547128-982a-482c-8879-455c35a4df34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:53.280205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547128-982a-482c-8879-455c35a4df34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:53.281839 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e9547128-982a-482c-8879-455c35a4df34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:53.386322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547128-982a-482c-8879-455c35a4df34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:53.387794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547128-982a-482c-8879-455c35a4df34 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:53.405650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 676/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:36:55.888952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae08f2-da20-4fad-896d-d9233c929ada None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:55.889422 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae08f2-da20-4fad-896d-d9233c929ada None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:55.889513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae08f2-da20-4fad-896d-d9233c929ada None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:55.890844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 656/1332] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:55.897246 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ce12-9c0a-4803-a8b3-1a3e21ce1808 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:55.897696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ce12-9c0a-4803-a8b3-1a3e21ce1808 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:55.897804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ce12-9c0a-4803-a8b3-1a3e21ce1808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:55.963517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4903ce12-9c0a-4803-a8b3-1a3e21ce1808 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:55.964715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4903ce12-9c0a-4803-a8b3-1a3e21ce1808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:56.055691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 677/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:56.091742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae08f2-da20-4fad-896d-d9233c929ada None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:56.093277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8cae08f2-da20-4fad-896d-d9233c929ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:56.192136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae08f2-da20-4fad-896d-d9233c929ada None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:56.264049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab970c-aab7-47cd-a534-91e96b20ada4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:56.264686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab970c-aab7-47cd-a534-91e96b20ada4 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:56.264965 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab970c-aab7-47cd-a534-91e96b20ada4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:56.265235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab970c-aab7-47cd-a534-91e96b20ada4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:56.266849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3aab970c-aab7-47cd-a534-91e96b20ada4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:56.371082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab970c-aab7-47cd-a534-91e96b20ada4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:56.372426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab970c-aab7-47cd-a534-91e96b20ada4 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:56.390542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 657/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:36:58.664649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04e78-3527-407c-84f9-aaa71c271811 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:58.665192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04e78-3527-407c-84f9-aaa71c271811 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:58.665192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f04e78-3527-407c-84f9-aaa71c271811 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:58.666605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 678/1335] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:58.672026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90107d3a-9e0b-4262-9263-3e3faeaa59e7 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:58.672489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90107d3a-9e0b-4262-9263-3e3faeaa59e7 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:58.672593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90107d3a-9e0b-4262-9263-3e3faeaa59e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:58.736573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-90107d3a-9e0b-4262-9263-3e3faeaa59e7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:58.737866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-90107d3a-9e0b-4262-9263-3e3faeaa59e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:58.831227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 658/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:36:58.871150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f04e78-3527-407c-84f9-aaa71c271811 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:58.872648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-55f04e78-3527-407c-84f9-aaa71c271811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:58.969013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f04e78-3527-407c-84f9-aaa71c271811 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:59.037526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4633e-91cc-4743-b9ff-f8986d885191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:59.038156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4633e-91cc-4743-b9ff-f8986d885191 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:59.038433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4633e-91cc-4743-b9ff-f8986d885191 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:59.038702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4633e-91cc-4743-b9ff-f8986d885191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:59.040336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-20a4633e-91cc-4743-b9ff-f8986d885191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:59.144247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4633e-91cc-4743-b9ff-f8986d885191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:59.146222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4633e-91cc-4743-b9ff-f8986d885191 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:59.163660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 679/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:01.753237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc691-d11e-4064-926c-65311ce691ce None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:01.753778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc691-d11e-4064-926c-65311ce691ce None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:01.753778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc691-d11e-4064-926c-65311ce691ce None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:01.755705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 659/1338] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:01.760794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2dce6-f3c8-4ef9-b43d-1201f30e382d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:01.761199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2dce6-f3c8-4ef9-b43d-1201f30e382d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:01.761341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2dce6-f3c8-4ef9-b43d-1201f30e382d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:01.822792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-0aa2dce6-f3c8-4ef9-b43d-1201f30e382d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:01.823992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0aa2dce6-f3c8-4ef9-b43d-1201f30e382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:01.918126 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 680/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:01.953194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcc691-d11e-4064-926c-65311ce691ce None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:01.954687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ffdcc691-d11e-4064-926c-65311ce691ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:02.052113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcc691-d11e-4064-926c-65311ce691ce None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:02.120752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b393-5a51-4d9c-a294-784e13e1ceb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:02.121384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b393-5a51-4d9c-a294-784e13e1ceb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:02.121663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b393-5a51-4d9c-a294-784e13e1ceb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:02.121935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b393-5a51-4d9c-a294-784e13e1ceb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:02.123568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-98a6b393-5a51-4d9c-a294-784e13e1ceb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:02.226299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b393-5a51-4d9c-a294-784e13e1ceb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:02.227690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b393-5a51-4d9c-a294-784e13e1ceb8 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:02.246792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 660/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:06.382272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b865-cac4-4b1e-924e-bd04733e0edf None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:06.382779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b865-cac4-4b1e-924e-bd04733e0edf None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:06.382779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b865-cac4-4b1e-924e-bd04733e0edf None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:06.384194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 681/1341] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:06.389515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5afd-ed56-4ee2-8521-4f56c7f614e8 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:06.389941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5afd-ed56-4ee2-8521-4f56c7f614e8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:06.390154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5afd-ed56-4ee2-8521-4f56c7f614e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:06.457724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-129d5afd-ed56-4ee2-8521-4f56c7f614e8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:06.459444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-129d5afd-ed56-4ee2-8521-4f56c7f614e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:06.558625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 661/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:06.597601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177b865-cac4-4b1e-924e-bd04733e0edf None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:06.600517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6177b865-cac4-4b1e-924e-bd04733e0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:06.693031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177b865-cac4-4b1e-924e-bd04733e0edf None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:06.696584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab43fb-d5a4-4171-b10e-ca1d0bd909c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:06.697222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab43fb-d5a4-4171-b10e-ca1d0bd909c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:06.697502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab43fb-d5a4-4171-b10e-ca1d0bd909c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:06.697773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab43fb-d5a4-4171-b10e-ca1d0bd909c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:06.706587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab43fb-d5a4-4171-b10e-ca1d0bd909c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:06.708606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab43fb-d5a4-4171-b10e-ca1d0bd909c1 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:06.718091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 682/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:09.502207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de689-aff4-42fb-ab81-76903bb3c614 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:09.502753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de689-aff4-42fb-ab81-76903bb3c614 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:09.502753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de689-aff4-42fb-ab81-76903bb3c614 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:09.504102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 662/1344] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:09.509300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a6b25-d010-448d-9dfc-35d368bb857e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:09.509734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a6b25-d010-448d-9dfc-35d368bb857e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:09.509829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a6b25-d010-448d-9dfc-35d368bb857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:09.542873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-846a6b25-d010-448d-9dfc-35d368bb857e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:09.543994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-846a6b25-d010-448d-9dfc-35d368bb857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:09.619888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 683/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:09.656495 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14de689-aff4-42fb-ab81-76903bb3c614 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:09.658183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a14de689-aff4-42fb-ab81-76903bb3c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:09.670939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14de689-aff4-42fb-ab81-76903bb3c614 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:09.674523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f4da9-91cc-4eeb-8c45-f1ad29a38a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:09.675179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f4da9-91cc-4eeb-8c45-f1ad29a38a6c service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:09.675460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f4da9-91cc-4eeb-8c45-f1ad29a38a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:09.675735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f4da9-91cc-4eeb-8c45-f1ad29a38a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:09.684900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f4da9-91cc-4eeb-8c45-f1ad29a38a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:09.686320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f4da9-91cc-4eeb-8c45-f1ad29a38a6c service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:09.695368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 663/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:14.284622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dea0e-67f5-416f-96f9-9043bc9f85b6 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:14.285163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dea0e-67f5-416f-96f9-9043bc9f85b6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:14.285163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dea0e-67f5-416f-96f9-9043bc9f85b6 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:14.286561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 684/1347] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:14.291762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cb96-c946-4c23-a39b-6f2960d74a10 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:14.292175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cb96-c946-4c23-a39b-6f2960d74a10 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:14.292312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6cb96-c946-4c23-a39b-6f2960d74a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:14.310080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-74f6cb96-c946-4c23-a39b-6f2960d74a10 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:14.311334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-74f6cb96-c946-4c23-a39b-6f2960d74a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:14.319523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 664/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:14.355891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dea0e-67f5-416f-96f9-9043bc9f85b6 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:14.366596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dea0e-67f5-416f-96f9-9043bc9f85b6 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:14.370035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de61a62-9ee1-4b3f-ab68-56427fe2acbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:14.370661 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61a62-9ee1-4b3f-ab68-56427fe2acbd service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:14.370943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61a62-9ee1-4b3f-ab68-56427fe2acbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:14.371241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61a62-9ee1-4b3f-ab68-56427fe2acbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:14.379669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de61a62-9ee1-4b3f-ab68-56427fe2acbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:14.381624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de61a62-9ee1-4b3f-ab68-56427fe2acbd service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:14.391061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 685/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:19.734942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152481-382a-4dca-b0db-a27a19c1c13b None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:19.735478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152481-382a-4dca-b0db-a27a19c1c13b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:19.735558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152481-382a-4dca-b0db-a27a19c1c13b None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:19.737398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 665/1350] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:19.742624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d897-03a2-43c6-b0b4-c425d78ee717 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:19.743433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d897-03a2-43c6-b0b4-c425d78ee717 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:19.743854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d897-03a2-43c6-b0b4-c425d78ee717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:19.826537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8669d897-03a2-43c6-b0b4-c425d78ee717 None None] MFA Rules not processed for user `63ed36df893640fc929d7953751d1116`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:19.828050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8669d897-03a2-43c6-b0b4-c425d78ee717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:19.924877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 686/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:37:23.979185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fce9f3-bb87-4e34-9b3f-4af059dabf39 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:23.979714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fce9f3-bb87-4e34-9b3f-4af059dabf39 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:23.979714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fce9f3-bb87-4e34-9b3f-4af059dabf39 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:23.981364 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 666/1352] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:23.988682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075d95-7df0-4919-b319-b2f85659c86b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:23.989705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075d95-7df0-4919-b319-b2f85659c86b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:23.990161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075d95-7df0-4919-b319-b2f85659c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:24.010080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8b075d95-7df0-4919-b319-b2f85659c86b None None] MFA Rules not processed for user `63ed36df893640fc929d7953751d1116`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:24.011984 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8b075d95-7df0-4919-b319-b2f85659c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:24.022878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 687/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:37:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:25.664043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63c12a-e2e8-4958-9d96-c3cb04e9fee0 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:25.664450 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63c12a-e2e8-4958-9d96-c3cb04e9fee0 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:25.664589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63c12a-e2e8-4958-9d96-c3cb04e9fee0 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:25.666015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 667/1354] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:25.671599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d11a5-915c-464a-a0b9-107e281ec3db None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:25.672032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d11a5-915c-464a-a0b9-107e281ec3db None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:25.672166 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d11a5-915c-464a-a0b9-107e281ec3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:25.690330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fb2d11a5-915c-464a-a0b9-107e281ec3db None None] MFA Rules not processed for user `63ed36df893640fc929d7953751d1116`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:25.691531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fb2d11a5-915c-464a-a0b9-107e281ec3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:25.700488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 688/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:29.732705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f5f63-32ec-45df-a9ab-31a47289488a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:29.733259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f5f63-32ec-45df-a9ab-31a47289488a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:29.733259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f5f63-32ec-45df-a9ab-31a47289488a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:29.734604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 668/1356] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:29.740874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a66b-3678-438c-afc6-158061683e0f None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:29.741301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a66b-3678-438c-afc6-158061683e0f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:29.741441 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a66b-3678-438c-afc6-158061683e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:29.759823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b441a66b-3678-438c-afc6-158061683e0f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:29.761113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b441a66b-3678-438c-afc6-158061683e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:29.769516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 689/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:29.817622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa98dd-47e0-46b1-822d-14d7d3448b2a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:29.817914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa98dd-47e0-46b1-822d-14d7d3448b2a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:29.818197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa98dd-47e0-46b1-822d-14d7d3448b2a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:29.819575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 669/1358] 10.222.0.57 () {54 vars in 961 bytes} [Tue May 10 16:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:29.824958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd621b9-2053-4a50-9698-bdad14afa1e7 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:29.825248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd621b9-2053-4a50-9698-bdad14afa1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:29.825525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd621b9-2053-4a50-9698-bdad14afa1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:29.876633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-2cd621b9-2053-4a50-9698-bdad14afa1e7 None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:29.878071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2cd621b9-2053-4a50-9698-bdad14afa1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:29.958923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 690/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Tue May 10 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:29.967358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa98dd-47e0-46b1-822d-14d7d3448b2a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:29.985885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa98dd-47e0-46b1-822d-14d7d3448b2a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:29.992124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55337493-aab5-41e4-9843-2dccd8d2e46c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:29.993025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337493-aab5-41e4-9843-2dccd8d2e46c service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:29.993525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337493-aab5-41e4-9843-2dccd8d2e46c service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:29.994182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337493-aab5-41e4-9843-2dccd8d2e46c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:30.003556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55337493-aab5-41e4-9843-2dccd8d2e46c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:30.005452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55337493-aab5-41e4-9843-2dccd8d2e46c service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:30.020518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 670/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:32.462253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139efc-74e1-49fb-91c8-319138596a8f None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:32.462795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139efc-74e1-49fb-91c8-319138596a8f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:32.462795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139efc-74e1-49fb-91c8-319138596a8f None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:32.464135 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 691/1361] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:32.469642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551132a1-fc0a-4dc9-aa6d-d27fd025db1b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:32.470070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551132a1-fc0a-4dc9-aa6d-d27fd025db1b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:32.470218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551132a1-fc0a-4dc9-aa6d-d27fd025db1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:32.488555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-551132a1-fc0a-4dc9-aa6d-d27fd025db1b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:32.490568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-551132a1-fc0a-4dc9-aa6d-d27fd025db1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:32.498703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 671/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:32.542590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139efc-74e1-49fb-91c8-319138596a8f None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:32.558054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139efc-74e1-49fb-91c8-319138596a8f None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:32.563793 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55932b7-e8b7-48f0-8abd-a7e4d01e445f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:32.564620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55932b7-e8b7-48f0-8abd-a7e4d01e445f service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:32.565069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55932b7-e8b7-48f0-8abd-a7e4d01e445f service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:32.565499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55932b7-e8b7-48f0-8abd-a7e4d01e445f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:32.574096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55932b7-e8b7-48f0-8abd-a7e4d01e445f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:32.575871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55932b7-e8b7-48f0-8abd-a7e4d01e445f service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:32.585933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 692/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:35.115979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055a446-4132-48f3-a92c-17939be3f654 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:35.116490 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055a446-4132-48f3-a92c-17939be3f654 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:35.116617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055a446-4132-48f3-a92c-17939be3f654 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:35.117902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 672/1364] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:35.123341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d39a50-57b0-47f8-b647-54ce50ab9df6 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:35.123756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d39a50-57b0-47f8-b647-54ce50ab9df6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:35.123900 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d39a50-57b0-47f8-b647-54ce50ab9df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:35.154457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-47d39a50-57b0-47f8-b647-54ce50ab9df6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:35.155692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-47d39a50-57b0-47f8-b647-54ce50ab9df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:35.175787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 693/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:35.212647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e9b1-7741-4aea-a9a8-7b6efc022d17 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:35.212908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e9b1-7741-4aea-a9a8-7b6efc022d17 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:35.213253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e9b1-7741-4aea-a9a8-7b6efc022d17 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:35.214907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 673/1366] 10.222.0.57 () {54 vars in 961 bytes} [Tue May 10 16:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:35.220492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7fc92-55b7-4f9c-8d00-843ee5c2033d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:35.220786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7fc92-55b7-4f9c-8d00-843ee5c2033d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:35.221066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7fc92-55b7-4f9c-8d00-843ee5c2033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:35.239076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-77f7fc92-55b7-4f9c-8d00-843ee5c2033d None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:35.240474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-77f7fc92-55b7-4f9c-8d00-843ee5c2033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:35.249607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 694/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Tue May 10 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:35.257922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850e9b1-7741-4aea-a9a8-7b6efc022d17 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:35.271831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850e9b1-7741-4aea-a9a8-7b6efc022d17 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:35.277173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93695f-71db-4ccf-9ea2-c1294f6f5fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:35.277797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93695f-71db-4ccf-9ea2-c1294f6f5fdf service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:35.278076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93695f-71db-4ccf-9ea2-c1294f6f5fdf service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:35.278343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93695f-71db-4ccf-9ea2-c1294f6f5fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:35.286136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93695f-71db-4ccf-9ea2-c1294f6f5fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:35.287743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93695f-71db-4ccf-9ea2-c1294f6f5fdf service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:35.297045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 674/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:37.625414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d48ba-9834-49b5-b125-7f3365f41965 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:37.625989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d48ba-9834-49b5-b125-7f3365f41965 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:37.625989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d48ba-9834-49b5-b125-7f3365f41965 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:37.627554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 695/1369] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:37.632583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203138-2472-4452-958a-dd6a48e3c94d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:37.633373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203138-2472-4452-958a-dd6a48e3c94d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:37.633657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad203138-2472-4452-958a-dd6a48e3c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:37.651752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ad203138-2472-4452-958a-dd6a48e3c94d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:37.652986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ad203138-2472-4452-958a-dd6a48e3c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:37.661967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 675/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:37.705725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d48ba-9834-49b5-b125-7f3365f41965 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:37.720633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d48ba-9834-49b5-b125-7f3365f41965 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:37.726802 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0393d1-d57d-46d3-8600-a293862efa4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:37.727467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0393d1-d57d-46d3-8600-a293862efa4c service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:37.727744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0393d1-d57d-46d3-8600-a293862efa4c service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:37.728014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0393d1-d57d-46d3-8600-a293862efa4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:37.736280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0393d1-d57d-46d3-8600-a293862efa4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:37.737866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0393d1-d57d-46d3-8600-a293862efa4c service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:37.748504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 696/1371] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:37.849982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf7d0-00a6-4929-b791-12fd59c173a4 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:37.850370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf7d0-00a6-4929-b791-12fd59c173a4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:37.850594 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bf7d0-00a6-4929-b791-12fd59c173a4 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:37.852073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 676/1372] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:37.858523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ec5a-5162-4e17-8d33-5defd6efd43f None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:37.858915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ec5a-5162-4e17-8d33-5defd6efd43f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:37.859230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571ec5a-5162-4e17-8d33-5defd6efd43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:37.881091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e571ec5a-5162-4e17-8d33-5defd6efd43f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:37.882752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e571ec5a-5162-4e17-8d33-5defd6efd43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:37.893947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 697/1373] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:38.204287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c103-ff03-4dff-a6bc-cfbad2e1420f None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:38.204287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c103-ff03-4dff-a6bc-cfbad2e1420f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:38.204287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c103-ff03-4dff-a6bc-cfbad2e1420f None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:38.206172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 677/1374] 10.222.0.57 () {54 vars in 963 bytes} [Tue May 10 16:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:38.210589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863157-992d-41d5-8f2d-02e476675333 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:38.210948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863157-992d-41d5-8f2d-02e476675333 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:38.211330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863157-992d-41d5-8f2d-02e476675333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:38.260312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-65863157-992d-41d5-8f2d-02e476675333 None None] MFA Rules not processed for user `c789864ed513471fb6b367aecf236828`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:38.261790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-65863157-992d-41d5-8f2d-02e476675333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:38.323285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 698/1375] 10.222.0.57 () {58 vars in 1060 bytes} [Tue May 10 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:38.330547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89c103-ff03-4dff-a6bc-cfbad2e1420f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:38.341931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89c103-ff03-4dff-a6bc-cfbad2e1420f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:38.347037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb8d22-fb8f-44f6-af54-8b123fa0716e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:38.347989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8d22-fb8f-44f6-af54-8b123fa0716e service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:38.348484 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8d22-fb8f-44f6-af54-8b123fa0716e service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:38.348980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8d22-fb8f-44f6-af54-8b123fa0716e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:38.358663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8d22-fb8f-44f6-af54-8b123fa0716e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:38.360379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8d22-fb8f-44f6-af54-8b123fa0716e service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:38.370585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 678/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:40.066402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb1731-a9bb-4b86-a112-826d29e286c5 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:40.067036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb1731-a9bb-4b86-a112-826d29e286c5 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:40.067036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb1731-a9bb-4b86-a112-826d29e286c5 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:40.068313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 699/1377] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:40.074233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ab7b8-64e1-4f78-9214-9ce5e67e9afb None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:40.074752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ab7b8-64e1-4f78-9214-9ce5e67e9afb None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:40.074891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ab7b8-64e1-4f78-9214-9ce5e67e9afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:40.092915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3b8ab7b8-64e1-4f78-9214-9ce5e67e9afb None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:40.094209 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3b8ab7b8-64e1-4f78-9214-9ce5e67e9afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:40.102698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 679/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:40.146300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb1731-a9bb-4b86-a112-826d29e286c5 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:40.161272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb1731-a9bb-4b86-a112-826d29e286c5 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:40.167101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6496c-1e15-4a8b-8c1e-c9823f164735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:40.167951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6496c-1e15-4a8b-8c1e-c9823f164735 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:40.168232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6496c-1e15-4a8b-8c1e-c9823f164735 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:40.168509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6496c-1e15-4a8b-8c1e-c9823f164735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:40.177910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6496c-1e15-4a8b-8c1e-c9823f164735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:40.179755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6496c-1e15-4a8b-8c1e-c9823f164735 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:40.189289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 700/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:42.469911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826438c6-32d7-4393-bd8b-2bb16042e26a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:42.470522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826438c6-32d7-4393-bd8b-2bb16042e26a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:42.470522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826438c6-32d7-4393-bd8b-2bb16042e26a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:42.471833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 680/1380] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:42.477020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198e53-395a-452d-9e20-20b2212afe81 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:42.477472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198e53-395a-452d-9e20-20b2212afe81 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:42.477561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198e53-395a-452d-9e20-20b2212afe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:42.495719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-90198e53-395a-452d-9e20-20b2212afe81 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:42.496897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-90198e53-395a-452d-9e20-20b2212afe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:42.505610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 701/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:42.548940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826438c6-32d7-4393-bd8b-2bb16042e26a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:42.564582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826438c6-32d7-4393-bd8b-2bb16042e26a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:42.570992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1a557-a8f5-435c-ad65-5ebd55d9054b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:42.571922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a557-a8f5-435c-ad65-5ebd55d9054b service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:42.572269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a557-a8f5-435c-ad65-5ebd55d9054b service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:42.572613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a557-a8f5-435c-ad65-5ebd55d9054b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:42.581570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1a557-a8f5-435c-ad65-5ebd55d9054b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:42.584409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1a557-a8f5-435c-ad65-5ebd55d9054b service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:42.594660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 681/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:44.840083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2258-5786-454d-80dc-87f3ce71fea2 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:44.840720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2258-5786-454d-80dc-87f3ce71fea2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:44.840720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f2258-5786-454d-80dc-87f3ce71fea2 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:44.842067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 702/1383] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:44.848059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cfbc-aab1-42c2-8f98-a86613db46ce None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:44.848598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cfbc-aab1-42c2-8f98-a86613db46ce None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:44.848598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cfbc-aab1-42c2-8f98-a86613db46ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:44.866319 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-7358cfbc-aab1-42c2-8f98-a86613db46ce None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:44.867514 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7358cfbc-aab1-42c2-8f98-a86613db46ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:44.880913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 682/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:44.921346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f2258-5786-454d-80dc-87f3ce71fea2 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:44.936791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f2258-5786-454d-80dc-87f3ce71fea2 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:44.943232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbafd61-3ce9-4f1c-b70f-eeb3d044a2b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:44.943902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbafd61-3ce9-4f1c-b70f-eeb3d044a2b2 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:44.944187 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbafd61-3ce9-4f1c-b70f-eeb3d044a2b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:44.944463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbafd61-3ce9-4f1c-b70f-eeb3d044a2b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:44.952553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbafd61-3ce9-4f1c-b70f-eeb3d044a2b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:44.954123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbafd61-3ce9-4f1c-b70f-eeb3d044a2b2 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:44.963962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 703/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:37:47.201561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6a51-f989-4bd7-ae7c-f4126223dcce None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:47.202141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6a51-f989-4bd7-ae7c-f4126223dcce None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:47.202359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc6a51-f989-4bd7-ae7c-f4126223dcce None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:47.204080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 683/1386] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:47.211118 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fcb-82ce-42d5-9c1e-6c707141726b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:47.211674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fcb-82ce-42d5-9c1e-6c707141726b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:47.211674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fcb-82ce-42d5-9c1e-6c707141726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:47.229577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5d827fcb-82ce-42d5-9c1e-6c707141726b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:47.230776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5d827fcb-82ce-42d5-9c1e-6c707141726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:47.238759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 704/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:37:47.292716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc6a51-f989-4bd7-ae7c-f4126223dcce None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:47.310287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc6a51-f989-4bd7-ae7c-f4126223dcce None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:47.316742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e57948-3d7f-476c-951f-755902f56853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:47.317517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e57948-3d7f-476c-951f-755902f56853 service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:47.317860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e57948-3d7f-476c-951f-755902f56853 service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:47.318203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e57948-3d7f-476c-951f-755902f56853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:47.328290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e57948-3d7f-476c-951f-755902f56853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:47.330231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e57948-3d7f-476c-951f-755902f56853 service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:47.342345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 684/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:37:49.692410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a53de-d983-4a3f-ab01-9572ac7033d3 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:49.692959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a53de-d983-4a3f-ab01-9572ac7033d3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:49.693062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a53de-d983-4a3f-ab01-9572ac7033d3 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:49.694425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 705/1389] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:49.700790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e5e43-f121-4b5e-ac17-38d750a3492c None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:49.701272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e5e43-f121-4b5e-ac17-38d750a3492c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:49.701389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e5e43-f121-4b5e-ac17-38d750a3492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:49.719323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-608e5e43-f121-4b5e-ac17-38d750a3492c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:49.720581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-608e5e43-f121-4b5e-ac17-38d750a3492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:49.729188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 685/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:49.776876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a53de-d983-4a3f-ab01-9572ac7033d3 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:49.794369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a53de-d983-4a3f-ab01-9572ac7033d3 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:49.800649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72546040-6d20-4ee1-b792-b4af2f30eff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:49.801949 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546040-6d20-4ee1-b792-b4af2f30eff9 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:49.802229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546040-6d20-4ee1-b792-b4af2f30eff9 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:49.802504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546040-6d20-4ee1-b792-b4af2f30eff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:49.810770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72546040-6d20-4ee1-b792-b4af2f30eff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:49.812391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72546040-6d20-4ee1-b792-b4af2f30eff9 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:49.821788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 706/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:52.133033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099efc2d-8e48-494b-8d1d-b42b96a15d02 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:52.133608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099efc2d-8e48-494b-8d1d-b42b96a15d02 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:52.133608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099efc2d-8e48-494b-8d1d-b42b96a15d02 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:52.134873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 686/1392] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:52.140249 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123650-4a17-4188-9016-344988cc56b1 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:52.140687 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123650-4a17-4188-9016-344988cc56b1 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:52.140792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123650-4a17-4188-9016-344988cc56b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:52.158887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-6e123650-4a17-4188-9016-344988cc56b1 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:52.160099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6e123650-4a17-4188-9016-344988cc56b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:52.167849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 707/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:52.211488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099efc2d-8e48-494b-8d1d-b42b96a15d02 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:52.226849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099efc2d-8e48-494b-8d1d-b42b96a15d02 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:52.232280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d2e48-7e62-42f3-9c32-a7c7cad7daa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:52.232916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d2e48-7e62-42f3-9c32-a7c7cad7daa1 service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:52.233205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d2e48-7e62-42f3-9c32-a7c7cad7daa1 service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:52.233484 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d2e48-7e62-42f3-9c32-a7c7cad7daa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:52.241817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d2e48-7e62-42f3-9c32-a7c7cad7daa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:52.243429 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d2e48-7e62-42f3-9c32-a7c7cad7daa1 service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:52.253033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 687/1394] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:53.978332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a58d-f570-479d-84fc-79cb2ecc6ec9 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:53.978867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a58d-f570-479d-84fc-79cb2ecc6ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:53.978867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a58d-f570-479d-84fc-79cb2ecc6ec9 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:53.980225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 708/1395] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:53.985532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5788-708a-413c-b510-ea6b2fadbeaa None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:53.985944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5788-708a-413c-b510-ea6b2fadbeaa None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:53.986096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5788-708a-413c-b510-ea6b2fadbeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.005270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-7f9d5788-708a-413c-b510-ea6b2fadbeaa None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:54.006468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7f9d5788-708a-413c-b510-ea6b2fadbeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:54.014592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 688/1396] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:54.071372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aceedf-2f15-418b-8cf4-f301ddeded66 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.071671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aceedf-2f15-418b-8cf4-f301ddeded66 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.071975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aceedf-2f15-418b-8cf4-f301ddeded66 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.073349 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 709/1397] 10.222.0.57 () {54 vars in 962 bytes} [Tue May 10 16:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:54.078392 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf04c4-e4e1-4c16-b3fa-942510171f88 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.078684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf04c4-e4e1-4c16-b3fa-942510171f88 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.078984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf04c4-e4e1-4c16-b3fa-942510171f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.132593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1caf04c4-e4e1-4c16-b3fa-942510171f88 None None] MFA Rules not processed for user `039df81163264994a86fe2e98bb96983`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:54.133786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1caf04c4-e4e1-4c16-b3fa-942510171f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:54.191008 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 689/1398] 10.222.0.57 () {58 vars in 1059 bytes} [Tue May 10 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:54.198915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aceedf-2f15-418b-8cf4-f301ddeded66 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:54.209628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aceedf-2f15-418b-8cf4-f301ddeded66 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:54.213217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b57c6-04f0-48b1-9b86-016c1188bc0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039df81163264994a86fe2e98bb96983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:54.213848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b57c6-04f0-48b1-9b86-016c1188bc0f service glance] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.214165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b57c6-04f0-48b1-9b86-016c1188bc0f service glance] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.214797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b57c6-04f0-48b1-9b86-016c1188bc0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.224721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b57c6-04f0-48b1-9b86-016c1188bc0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:54.226134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b57c6-04f0-48b1-9b86-016c1188bc0f service glance] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:54.235539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 710/1399] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:54.498794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867de58-c0de-4d64-ae54-0104018c20de None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.499021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867de58-c0de-4d64-ae54-0104018c20de None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.499276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867de58-c0de-4d64-ae54-0104018c20de None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.504114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 690/1400] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:54.506355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f10d0-6c3e-4c19-abbf-4436547957f3 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.506646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f10d0-6c3e-4c19-abbf-4436547957f3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.506925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f10d0-6c3e-4c19-abbf-4436547957f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.526815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-587f10d0-6c3e-4c19-abbf-4436547957f3 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:54.528173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-587f10d0-6c3e-4c19-abbf-4436547957f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:54.536831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 711/1401] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:54.580757 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867de58-c0de-4d64-ae54-0104018c20de None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:54.594388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867de58-c0de-4d64-ae54-0104018c20de None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:54.600143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f900b-35a1-46db-bc49-18a12898cb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:54.600771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f900b-35a1-46db-bc49-18a12898cb56 service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.601047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f900b-35a1-46db-bc49-18a12898cb56 service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.601325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f900b-35a1-46db-bc49-18a12898cb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.609495 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f900b-35a1-46db-bc49-18a12898cb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:54.611117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f900b-35a1-46db-bc49-18a12898cb56 service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:54.624731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 691/1402] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:37:54.671887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d3a7-69a3-4917-aa41-12a052119f5c None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.672252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d3a7-69a3-4917-aa41-12a052119f5c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.672529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d3a7-69a3-4917-aa41-12a052119f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.728453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-77a6d3a7-69a3-4917-aa41-12a052119f5c None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:54.729685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-77a6d3a7-69a3-4917-aa41-12a052119f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:54.800415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 712/1403] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:54.848611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c514747-3a77-4cda-b290-091f4aaac773 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.848896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c514747-3a77-4cda-b290-091f4aaac773 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.849178 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c514747-3a77-4cda-b290-091f4aaac773 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.850612 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 692/1404] 10.222.0.57 () {54 vars in 942 bytes} [Tue May 10 16:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:54.857570 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad099e0-2e30-4f94-8bd6-4120c0e389aa None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:54.857859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad099e0-2e30-4f94-8bd6-4120c0e389aa None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:54.858135 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad099e0-2e30-4f94-8bd6-4120c0e389aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:54.906369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7ad099e0-2e30-4f94-8bd6-4120c0e389aa None None] MFA Rules not processed for user `5551a6e71bb0499d9161e6213acc0af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:54.907583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7ad099e0-2e30-4f94-8bd6-4120c0e389aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:54.977007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 713/1405] 10.222.0.57 () {58 vars in 1039 bytes} [Tue May 10 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:37:54.986512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c514747-3a77-4cda-b290-091f4aaac773 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:55.000057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c514747-3a77-4cda-b290-091f4aaac773 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:55.005492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96205-7b2c-4b22-bb2d-823ed69e9cd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:55.006131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96205-7b2c-4b22-bb2d-823ed69e9cd7 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:55.006417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96205-7b2c-4b22-bb2d-823ed69e9cd7 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:55.006689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96205-7b2c-4b22-bb2d-823ed69e9cd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:55.014699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96205-7b2c-4b22-bb2d-823ed69e9cd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:55.016311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96205-7b2c-4b22-bb2d-823ed69e9cd7 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:55.024934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 693/1406] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:37:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:37:56.900924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b07d9-f0ea-4f2c-8751-8ba3e282f276 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:56.901476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b07d9-f0ea-4f2c-8751-8ba3e282f276 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:56.901476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b07d9-f0ea-4f2c-8751-8ba3e282f276 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:56.908799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ef40-9704-4d52-9f85-a8920661b285 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:56.909350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ef40-9704-4d52-9f85-a8920661b285 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:56.909566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ef40-9704-4d52-9f85-a8920661b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:56.911278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 714/1407] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:37:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:37:56.931588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1da5ef40-9704-4d52-9f85-a8920661b285 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:56.932976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1da5ef40-9704-4d52-9f85-a8920661b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:56.944048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 694/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:37:56.987029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b07d9-f0ea-4f2c-8751-8ba3e282f276 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:57.006495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b07d9-f0ea-4f2c-8751-8ba3e282f276 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:57.012322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ec295-7edf-495b-b536-263ee351d7e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:57.013164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec295-7edf-495b-b536-263ee351d7e1 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:57.013438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec295-7edf-495b-b536-263ee351d7e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:57.013701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec295-7edf-495b-b536-263ee351d7e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:57.021915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ec295-7edf-495b-b536-263ee351d7e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:57.023517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ec295-7edf-495b-b536-263ee351d7e1 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:57.035541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 715/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:18.676389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17b1f-2f9f-4dc0-87de-2ebb94b7011f None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:18.677040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17b1f-2f9f-4dc0-87de-2ebb94b7011f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:18.677040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17b1f-2f9f-4dc0-87de-2ebb94b7011f None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:18.678345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 695/1410] 10.222.0.57 () {54 vars in 918 bytes} [Tue May 10 16:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:18.683589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574780-5b0a-4067-b8ef-9d14cd459eaa None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:18.684033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574780-5b0a-4067-b8ef-9d14cd459eaa None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:18.684138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574780-5b0a-4067-b8ef-9d14cd459eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:18.702151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f5574780-5b0a-4067-b8ef-9d14cd459eaa None None] MFA Rules not processed for user `63ed36df893640fc929d7953751d1116`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:18.703369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f5574780-5b0a-4067-b8ef-9d14cd459eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:18.711701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 716/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Tue May 10 16:38:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:18.725668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3bfd-9402-4fe6-9a0a-1e72d45ca116 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:18.725948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3bfd-9402-4fe6-9a0a-1e72d45ca116 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:18.726216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3bfd-9402-4fe6-9a0a-1e72d45ca116 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:18.727569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 696/1412] 10.222.0.57 () {54 vars in 918 bytes} [Tue May 10 16:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:18.731946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d78bab-96a8-4879-8466-72bd61ed8df7 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:18.732225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d78bab-96a8-4879-8466-72bd61ed8df7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:18.732496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d78bab-96a8-4879-8466-72bd61ed8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:18.749828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-31d78bab-96a8-4879-8466-72bd61ed8df7 None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:18.750994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-31d78bab-96a8-4879-8466-72bd61ed8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:18.760393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 717/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Tue May 10 16:38:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:38:21.483276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1f1f-2d08-459c-90d2-ab301e11c382 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:21.483859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1f1f-2d08-459c-90d2-ab301e11c382 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:21.483859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1f1f-2d08-459c-90d2-ab301e11c382 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:21.485201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:21.491365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fa99-63e3-4238-9d81-73df66d50e86 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:21.491819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fa99-63e3-4238-9d81-73df66d50e86 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:21.491928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69fa99-63e3-4238-9d81-73df66d50e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:21.508882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-bb69fa99-63e3-4238-9d81-73df66d50e86 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:21.510074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bb69fa99-63e3-4238-9d81-73df66d50e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:21.517981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:21.559780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b1f1f-2d08-459c-90d2-ab301e11c382 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:21.573565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b1f1f-2d08-459c-90d2-ab301e11c382 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:21.578840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1af48-93e6-472e-b518-76e8e9a19e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:21.579493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1af48-93e6-472e-b518-76e8e9a19e02 service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:21.579774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1af48-93e6-472e-b518-76e8e9a19e02 service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:21.580048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1af48-93e6-472e-b518-76e8e9a19e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:21.587870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1af48-93e6-472e-b518-76e8e9a19e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:21.589437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1af48-93e6-472e-b518-76e8e9a19e02 service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:21.598911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 698/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:22.579948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e223ad-582c-4dac-b42c-ddaf544e43b8 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:22.580526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e223ad-582c-4dac-b42c-ddaf544e43b8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:22.580526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e223ad-582c-4dac-b42c-ddaf544e43b8 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:22.581945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:22.586946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62298-5da1-459f-b270-3430a0de7c35 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:22.587396 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62298-5da1-459f-b270-3430a0de7c35 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:22.587506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62298-5da1-459f-b270-3430a0de7c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:22.604912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-cde62298-5da1-459f-b270-3430a0de7c35 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:22.606112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-cde62298-5da1-459f-b270-3430a0de7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:22.614354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:22.777735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e223ad-582c-4dac-b42c-ddaf544e43b8 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:22.791928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e223ad-582c-4dac-b42c-ddaf544e43b8 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:22.797402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc077e-c4d6-4c9a-b710-93828678eb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:22.798028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc077e-c4d6-4c9a-b710-93828678eb1b service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:22.798306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc077e-c4d6-4c9a-b710-93828678eb1b service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:22.798576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc077e-c4d6-4c9a-b710-93828678eb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:22.806865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc077e-c4d6-4c9a-b710-93828678eb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:22.808453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc077e-c4d6-4c9a-b710-93828678eb1b service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:22.817426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 720/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:23.750299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62bd59-0211-4961-adb6-dd946775504b None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:23.750879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62bd59-0211-4961-adb6-dd946775504b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:23.750879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62bd59-0211-4961-adb6-dd946775504b None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:23.752260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:23.757832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96d9a-0332-497e-83d8-51d2a9d483c2 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:23.758244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96d9a-0332-497e-83d8-51d2a9d483c2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:23.758415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96d9a-0332-497e-83d8-51d2a9d483c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:23.776475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c8d96d9a-0332-497e-83d8-51d2a9d483c2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:23.777665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c8d96d9a-0332-497e-83d8-51d2a9d483c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:23.785361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:23.938004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62bd59-0211-4961-adb6-dd946775504b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:23.952981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62bd59-0211-4961-adb6-dd946775504b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:23.958278 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a7628-145f-41db-86b7-07fc03dc960c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:23.958914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7628-145f-41db-86b7-07fc03dc960c service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:23.959234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7628-145f-41db-86b7-07fc03dc960c service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:23.959511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7628-145f-41db-86b7-07fc03dc960c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:23.967640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a7628-145f-41db-86b7-07fc03dc960c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:23.969205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a7628-145f-41db-86b7-07fc03dc960c service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:23.978167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 701/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:24.890539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505b869-5d2f-45cd-8999-ae30d02de58e None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:24.891053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505b869-5d2f-45cd-8999-ae30d02de58e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:24.891344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505b869-5d2f-45cd-8999-ae30d02de58e None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:24.892528 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:24.898596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4521f95-32b2-4975-82bd-4a73ff80c603 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:24.899091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4521f95-32b2-4975-82bd-4a73ff80c603 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:24.899205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4521f95-32b2-4975-82bd-4a73ff80c603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:24.917162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-b4521f95-32b2-4975-82bd-4a73ff80c603 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:24.918347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b4521f95-32b2-4975-82bd-4a73ff80c603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:24.926362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:25.073548 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505b869-5d2f-45cd-8999-ae30d02de58e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:25.088040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505b869-5d2f-45cd-8999-ae30d02de58e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:25.093287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ffc66-a78a-4538-9f62-454449401d96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:25.093915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ffc66-a78a-4538-9f62-454449401d96 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:25.094195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ffc66-a78a-4538-9f62-454449401d96 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:25.094472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ffc66-a78a-4538-9f62-454449401d96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:25.102302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ffc66-a78a-4538-9f62-454449401d96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:25.103898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ffc66-a78a-4538-9f62-454449401d96 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:25.112962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 723/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:26.051193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e95a6-211a-4e1f-93ec-a372959e3f0f None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:26.051728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e95a6-211a-4e1f-93ec-a372959e3f0f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:26.051728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e95a6-211a-4e1f-93ec-a372959e3f0f None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:26.053021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:26.058338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175bc5a-04e1-44a5-ba73-ce7c23bb8b70 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:26.058772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175bc5a-04e1-44a5-ba73-ce7c23bb8b70 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:26.058886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175bc5a-04e1-44a5-ba73-ce7c23bb8b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:26.076812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7175bc5a-04e1-44a5-ba73-ce7c23bb8b70 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:26.078241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7175bc5a-04e1-44a5-ba73-ce7c23bb8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:26.086605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:26.242261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e95a6-211a-4e1f-93ec-a372959e3f0f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:26.256182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e95a6-211a-4e1f-93ec-a372959e3f0f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:26.261398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aa274-57b8-413a-a66f-5574e40210ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:26.262022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa274-57b8-413a-a66f-5574e40210ea service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:26.262304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa274-57b8-413a-a66f-5574e40210ea service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:26.262577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa274-57b8-413a-a66f-5574e40210ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:26.270846 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aa274-57b8-413a-a66f-5574e40210ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:26.272443 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aa274-57b8-413a-a66f-5574e40210ea service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:26.281459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 704/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:27.146889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131603c2-2eb2-4063-a51f-7dafa878ad5c None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:27.147494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131603c2-2eb2-4063-a51f-7dafa878ad5c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:27.147494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131603c2-2eb2-4063-a51f-7dafa878ad5c None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:27.148816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:27.153716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93637aa2-813f-4c4f-b6a8-1811dee40ba4 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:27.154142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93637aa2-813f-4c4f-b6a8-1811dee40ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:27.154286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93637aa2-813f-4c4f-b6a8-1811dee40ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:27.171878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-93637aa2-813f-4c4f-b6a8-1811dee40ba4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:27.173058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-93637aa2-813f-4c4f-b6a8-1811dee40ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:27.181218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:38:27.329162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131603c2-2eb2-4063-a51f-7dafa878ad5c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:27.343151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131603c2-2eb2-4063-a51f-7dafa878ad5c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:27.348873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7f4fe-1080-4dda-907e-4765ae8b797f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:27.349509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7f4fe-1080-4dda-907e-4765ae8b797f service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:27.349789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7f4fe-1080-4dda-907e-4765ae8b797f service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:27.350064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7f4fe-1080-4dda-907e-4765ae8b797f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:27.358121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7f4fe-1080-4dda-907e-4765ae8b797f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:27.359782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7f4fe-1080-4dda-907e-4765ae8b797f service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:27.369764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 726/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:28.243992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b3ab-a564-4080-868a-bb129ca3a32f None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:28.244556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b3ab-a564-4080-868a-bb129ca3a32f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:28.244556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58b3ab-a564-4080-868a-bb129ca3a32f None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:28.245916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:28.250758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde419e-75c8-4f0e-8335-856e5ad146ba None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:28.251234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde419e-75c8-4f0e-8335-856e5ad146ba None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:28.251385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde419e-75c8-4f0e-8335-856e5ad146ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:28.270552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1dde419e-75c8-4f0e-8335-856e5ad146ba None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:28.271770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1dde419e-75c8-4f0e-8335-856e5ad146ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:28.279410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:28.428725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b3ab-a564-4080-868a-bb129ca3a32f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:28.443047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58b3ab-a564-4080-868a-bb129ca3a32f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:28.448257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3d4d1-f631-4668-9765-b7bf1f6fd1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:28.448885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3d4d1-f631-4668-9765-b7bf1f6fd1ae service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:28.449162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3d4d1-f631-4668-9765-b7bf1f6fd1ae service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:28.449437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3d4d1-f631-4668-9765-b7bf1f6fd1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:28.457370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3d4d1-f631-4668-9765-b7bf1f6fd1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:28.458939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3d4d1-f631-4668-9765-b7bf1f6fd1ae service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:28.468028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 707/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:29.338898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94971-7be0-4c33-8691-6cf3c6aa632d None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:29.339509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94971-7be0-4c33-8691-6cf3c6aa632d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:29.339509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94971-7be0-4c33-8691-6cf3c6aa632d None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:29.340820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:29.345667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad83725-186b-4d2b-9e59-158e60520104 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:29.346082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad83725-186b-4d2b-9e59-158e60520104 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:29.346226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad83725-186b-4d2b-9e59-158e60520104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:29.364584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-bad83725-186b-4d2b-9e59-158e60520104 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:29.365779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-bad83725-186b-4d2b-9e59-158e60520104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:29.373513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:29.521415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94971-7be0-4c33-8691-6cf3c6aa632d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:29.535447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94971-7be0-4c33-8691-6cf3c6aa632d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:29.540746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d5947-f0d3-4b62-aa00-15bbbb687a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:29.541369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d5947-f0d3-4b62-aa00-15bbbb687a85 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:29.541647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d5947-f0d3-4b62-aa00-15bbbb687a85 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:29.541917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d5947-f0d3-4b62-aa00-15bbbb687a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:29.550001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d5947-f0d3-4b62-aa00-15bbbb687a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:29.551730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d5947-f0d3-4b62-aa00-15bbbb687a85 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:29.560640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 729/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:30.432943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a34ff0-05e2-4f9c-a3e8-54f0da1af48a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:30.433526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a34ff0-05e2-4f9c-a3e8-54f0da1af48a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:30.433526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a34ff0-05e2-4f9c-a3e8-54f0da1af48a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:30.434839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:30.439668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116624e0-2ae2-482f-8c79-e0927adb7c67 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:30.440116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116624e0-2ae2-482f-8c79-e0927adb7c67 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:30.440224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116624e0-2ae2-482f-8c79-e0927adb7c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:30.457494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-116624e0-2ae2-482f-8c79-e0927adb7c67 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:30.458666 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-116624e0-2ae2-482f-8c79-e0927adb7c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:30.466208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:30.612830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a34ff0-05e2-4f9c-a3e8-54f0da1af48a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:30.627093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a34ff0-05e2-4f9c-a3e8-54f0da1af48a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:30.632258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a7957-a216-4151-bb41-832e80ac42cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:30.632881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a7957-a216-4151-bb41-832e80ac42cd service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:30.633157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a7957-a216-4151-bb41-832e80ac42cd service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:30.633431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a7957-a216-4151-bb41-832e80ac42cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:30.641139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a7957-a216-4151-bb41-832e80ac42cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:30.642696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a7957-a216-4151-bb41-832e80ac42cd service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:30.652099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 710/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:32.752364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979f9d-a5d7-4617-9e9b-552238e77a05 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:32.752889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979f9d-a5d7-4617-9e9b-552238e77a05 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:32.753014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979f9d-a5d7-4617-9e9b-552238e77a05 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:32.754789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:32.760048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7b499-0c17-4057-90d6-4a34ae79eeb5 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:32.760492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7b499-0c17-4057-90d6-4a34ae79eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:32.760632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7b499-0c17-4057-90d6-4a34ae79eeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:32.778298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-9bd7b499-0c17-4057-90d6-4a34ae79eeb5 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:32.779497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9bd7b499-0c17-4057-90d6-4a34ae79eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:32.787077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:32.824422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31979f9d-a5d7-4617-9e9b-552238e77a05 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:32.835338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31979f9d-a5d7-4617-9e9b-552238e77a05 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:32.838749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121af37d-1d91-4e48-97fb-d8f58d020e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:32.839408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af37d-1d91-4e48-97fb-d8f58d020e9f service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:32.839688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af37d-1d91-4e48-97fb-d8f58d020e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:32.839961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121af37d-1d91-4e48-97fb-d8f58d020e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:32.848523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121af37d-1d91-4e48-97fb-d8f58d020e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:32.849938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121af37d-1d91-4e48-97fb-d8f58d020e9f service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:32.859269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 732/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:35.211547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d48d6-6c8d-4495-bc79-abb587ddce32 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:35.212173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d48d6-6c8d-4495-bc79-abb587ddce32 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:35.212173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d48d6-6c8d-4495-bc79-abb587ddce32 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:35.213515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:35.218834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016c39-ac57-416d-821e-e2149af65c04 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:35.219273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016c39-ac57-416d-821e-e2149af65c04 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:35.219423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016c39-ac57-416d-821e-e2149af65c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:35.237162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-44016c39-ac57-416d-821e-e2149af65c04 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:35.238336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-44016c39-ac57-416d-821e-e2149af65c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:35.246089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:35.283765 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d48d6-6c8d-4495-bc79-abb587ddce32 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:35.294504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d48d6-6c8d-4495-bc79-abb587ddce32 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:35.298171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b723c2d-561b-4a9b-bf0a-f24a917c2aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:35.298789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b723c2d-561b-4a9b-bf0a-f24a917c2aae service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:35.299107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b723c2d-561b-4a9b-bf0a-f24a917c2aae service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:35.299378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b723c2d-561b-4a9b-bf0a-f24a917c2aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:35.307888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b723c2d-561b-4a9b-bf0a-f24a917c2aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:35.309292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b723c2d-561b-4a9b-bf0a-f24a917c2aae service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:35.318265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 713/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:37.825182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954ce0-3528-4698-8d41-8b811f540b2f None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:37.825718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954ce0-3528-4698-8d41-8b811f540b2f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:37.825718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f954ce0-3528-4698-8d41-8b811f540b2f None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:37.827112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:37.832354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97385-56a3-4c7f-b555-2cacf004a22e None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:37.832772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97385-56a3-4c7f-b555-2cacf004a22e None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:37.832994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97385-56a3-4c7f-b555-2cacf004a22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:37.850467 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-2eb97385-56a3-4c7f-b555-2cacf004a22e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:37.851658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-2eb97385-56a3-4c7f-b555-2cacf004a22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:37.859578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:37.897248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f954ce0-3528-4698-8d41-8b811f540b2f None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:37.907613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f954ce0-3528-4698-8d41-8b811f540b2f None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:37.911633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73b34-7ef2-4da3-bca5-201fada20d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:37.912262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73b34-7ef2-4da3-bca5-201fada20d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:37.912540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73b34-7ef2-4da3-bca5-201fada20d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:37.912812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73b34-7ef2-4da3-bca5-201fada20d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:37.921367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73b34-7ef2-4da3-bca5-201fada20d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:37.923077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73b34-7ef2-4da3-bca5-201fada20d6f service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:37.933008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 735/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:40.318842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483612a-835b-4c0a-a400-94840964a30c None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:40.319479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483612a-835b-4c0a-a400-94840964a30c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:40.319479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483612a-835b-4c0a-a400-94840964a30c None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:40.320823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:40.325984 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c75d-2bca-460e-9bc1-0c71fcbcc862 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:40.326439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c75d-2bca-460e-9bc1-0c71fcbcc862 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:40.326542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c75d-2bca-460e-9bc1-0c71fcbcc862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:40.343721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-bf47c75d-2bca-460e-9bc1-0c71fcbcc862 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:40.344915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bf47c75d-2bca-460e-9bc1-0c71fcbcc862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:40.353091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:40.391390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483612a-835b-4c0a-a400-94840964a30c None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:40.402577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483612a-835b-4c0a-a400-94840964a30c None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:40.406081 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ab2cb-95ef-4fdd-b8f9-f087e38167ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:40.406711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab2cb-95ef-4fdd-b8f9-f087e38167ee service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:40.407014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab2cb-95ef-4fdd-b8f9-f087e38167ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:40.407294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab2cb-95ef-4fdd-b8f9-f087e38167ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:40.416418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ab2cb-95ef-4fdd-b8f9-f087e38167ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:40.417839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ab2cb-95ef-4fdd-b8f9-f087e38167ee service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:40.427206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 716/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:42.819456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df33c4-82dc-4a69-85d7-ee481c36a81e None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:42.820047 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df33c4-82dc-4a69-85d7-ee481c36a81e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:42.820047 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df33c4-82dc-4a69-85d7-ee481c36a81e None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:42.821367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:42.827756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aaa66-63fd-4cb9-b68e-0c877ccff0fa None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:42.828162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aaa66-63fd-4cb9-b68e-0c877ccff0fa None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:42.828301 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aaa66-63fd-4cb9-b68e-0c877ccff0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:42.845753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-973aaa66-63fd-4cb9-b68e-0c877ccff0fa None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:42.846938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-973aaa66-63fd-4cb9-b68e-0c877ccff0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:42.854527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:42.892269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df33c4-82dc-4a69-85d7-ee481c36a81e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:42.902534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df33c4-82dc-4a69-85d7-ee481c36a81e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:42.906297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047beda-6d73-4f17-8f95-ea291be75354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:42.906921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047beda-6d73-4f17-8f95-ea291be75354 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:42.907229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047beda-6d73-4f17-8f95-ea291be75354 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:42.907501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047beda-6d73-4f17-8f95-ea291be75354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:42.916068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047beda-6d73-4f17-8f95-ea291be75354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:42.917471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047beda-6d73-4f17-8f95-ea291be75354 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:42.927503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 738/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:45.183902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5020f-25b8-4e9c-a3ee-10713a460087 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:45.184474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5020f-25b8-4e9c-a3ee-10713a460087 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:45.184474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5020f-25b8-4e9c-a3ee-10713a460087 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:45.185804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:45.191775 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d947-6e3a-4531-9eba-35973d4893d2 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:45.192221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d947-6e3a-4531-9eba-35973d4893d2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:45.192350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1d947-6e3a-4531-9eba-35973d4893d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:45.209255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-9aa1d947-6e3a-4531-9eba-35973d4893d2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:45.210424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9aa1d947-6e3a-4531-9eba-35973d4893d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:45.218078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:45.255571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5020f-25b8-4e9c-a3ee-10713a460087 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:45.265877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5020f-25b8-4e9c-a3ee-10713a460087 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:45.269350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786360d1-8c08-405a-bb0a-0f20d652bcf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:45.269972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786360d1-8c08-405a-bb0a-0f20d652bcf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:45.270251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786360d1-8c08-405a-bb0a-0f20d652bcf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:45.270524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786360d1-8c08-405a-bb0a-0f20d652bcf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:45.279066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786360d1-8c08-405a-bb0a-0f20d652bcf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:45.280485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786360d1-8c08-405a-bb0a-0f20d652bcf8 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:45.290010 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 719/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:47.533948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588e24-5c21-4101-852c-8a2558bd377f None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:47.535045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588e24-5c21-4101-852c-8a2558bd377f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:47.535172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588e24-5c21-4101-852c-8a2558bd377f None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:47.536479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:47.541773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fac4c-7945-43c4-8fef-165f3c51dae0 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:47.542179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fac4c-7945-43c4-8fef-165f3c51dae0 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:47.542329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fac4c-7945-43c4-8fef-165f3c51dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:47.561221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-0f4fac4c-7945-43c4-8fef-165f3c51dae0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:47.562403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-0f4fac4c-7945-43c4-8fef-165f3c51dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:47.570149 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:47.606486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588e24-5c21-4101-852c-8a2558bd377f None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:47.617446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588e24-5c21-4101-852c-8a2558bd377f None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:47.620935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd31ee-7e2e-495b-9001-b04f65688ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:47.621560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd31ee-7e2e-495b-9001-b04f65688ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:47.621835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd31ee-7e2e-495b-9001-b04f65688ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:47.622104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd31ee-7e2e-495b-9001-b04f65688ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:47.630649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd31ee-7e2e-495b-9001-b04f65688ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:47.632092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd31ee-7e2e-495b-9001-b04f65688ee8 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:47.641141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 741/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:49.906812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92becd2f-fae5-4fe5-8beb-b16ddd721a8f None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:49.907368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92becd2f-fae5-4fe5-8beb-b16ddd721a8f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:49.907368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92becd2f-fae5-4fe5-8beb-b16ddd721a8f None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:49.908744 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:49.914504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656c344-59a8-4283-ad27-1cc191983c57 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:49.914944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656c344-59a8-4283-ad27-1cc191983c57 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:49.915101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656c344-59a8-4283-ad27-1cc191983c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:49.933283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-6656c344-59a8-4283-ad27-1cc191983c57 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:49.934461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6656c344-59a8-4283-ad27-1cc191983c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:49.942225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:49.979049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92becd2f-fae5-4fe5-8beb-b16ddd721a8f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:49.990055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92becd2f-fae5-4fe5-8beb-b16ddd721a8f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:49.993716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8933b-0e3f-4061-af87-58c128456069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:49.994348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8933b-0e3f-4061-af87-58c128456069 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:49.994626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8933b-0e3f-4061-af87-58c128456069 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:49.994898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8933b-0e3f-4061-af87-58c128456069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:50.003621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8933b-0e3f-4061-af87-58c128456069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:50.005040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8933b-0e3f-4061-af87-58c128456069 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:50.013983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 722/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:52.221919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78072-67e2-4577-81fe-a6ddf2282dea None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:52.222489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78072-67e2-4577-81fe-a6ddf2282dea None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:52.222489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78072-67e2-4577-81fe-a6ddf2282dea None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:52.224146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:52.229294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff69f12-8837-45cf-9f2e-95a77f8b983d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:52.229701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff69f12-8837-45cf-9f2e-95a77f8b983d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:52.229883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff69f12-8837-45cf-9f2e-95a77f8b983d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:52.247822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6ff69f12-8837-45cf-9f2e-95a77f8b983d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:52.248998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6ff69f12-8837-45cf-9f2e-95a77f8b983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:52.257116 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:52.292342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e78072-67e2-4577-81fe-a6ddf2282dea None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:52.303143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e78072-67e2-4577-81fe-a6ddf2282dea None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:52.306584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65cf64-0ce7-4918-b6cb-0b9547ccf710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:52.307286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65cf64-0ce7-4918-b6cb-0b9547ccf710 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:52.307566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65cf64-0ce7-4918-b6cb-0b9547ccf710 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:52.307838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65cf64-0ce7-4918-b6cb-0b9547ccf710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:52.316832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65cf64-0ce7-4918-b6cb-0b9547ccf710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:52.318243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65cf64-0ce7-4918-b6cb-0b9547ccf710 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:52.327266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 744/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:38:54.548331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f1c2-beee-4180-9e12-19bc64ea054f None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:54.548883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f1c2-beee-4180-9e12-19bc64ea054f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:54.548883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f1c2-beee-4180-9e12-19bc64ea054f None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:54.550215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:54.555834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd288-ab6e-49b6-83d0-4bb90054797d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:54.556274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd288-ab6e-49b6-83d0-4bb90054797d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:54.556387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd288-ab6e-49b6-83d0-4bb90054797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:54.573925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c46fd288-ab6e-49b6-83d0-4bb90054797d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:54.575142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c46fd288-ab6e-49b6-83d0-4bb90054797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:54.583480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:38:54.618640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f1c2-beee-4180-9e12-19bc64ea054f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:54.629548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f1c2-beee-4180-9e12-19bc64ea054f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:54.632995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3e0d8-f6be-4ea0-81a6-ed87407e6531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:54.633616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e0d8-f6be-4ea0-81a6-ed87407e6531 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:54.633890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e0d8-f6be-4ea0-81a6-ed87407e6531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:54.634160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e0d8-f6be-4ea0-81a6-ed87407e6531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:54.643730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3e0d8-f6be-4ea0-81a6-ed87407e6531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:54.645182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3e0d8-f6be-4ea0-81a6-ed87407e6531 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:54.654586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 725/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:27.703908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1cc3-3e76-44b7-9890-08e612cd2028 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:27.704520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1cc3-3e76-44b7-9890-08e612cd2028 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:27.704520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1cc3-3e76-44b7-9890-08e612cd2028 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:27.705866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 746/1471] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:27.710899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255aa2-4c30-4a00-b312-983085b4b3fb None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:27.711333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255aa2-4c30-4a00-b312-983085b4b3fb None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:27.711473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255aa2-4c30-4a00-b312-983085b4b3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:27.729745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-f9255aa2-4c30-4a00-b312-983085b4b3fb None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:27.730332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f9255aa2-4c30-4a00-b312-983085b4b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:27.738709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 726/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:27.784240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bea47-a97e-4b86-b375-e169efc73e6a None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:27.784531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bea47-a97e-4b86-b375-e169efc73e6a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:27.784808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bea47-a97e-4b86-b375-e169efc73e6a None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:27.786193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 747/1473] 10.222.0.57 () {54 vars in 962 bytes} [Tue May 10 16:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:27.790682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3a7e2-3ac7-4864-8cf3-76837c13745a None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:27.790992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3a7e2-3ac7-4864-8cf3-76837c13745a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:27.791271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3a7e2-3ac7-4864-8cf3-76837c13745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:27.809333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-07c3a7e2-3ac7-4864-8cf3-76837c13745a None None] MFA Rules not processed for user `039df81163264994a86fe2e98bb96983`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:27.810487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-07c3a7e2-3ac7-4864-8cf3-76837c13745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:27.816769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 727/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Tue May 10 16:39:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:27.823549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bea47-a97e-4b86-b375-e169efc73e6a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:27.833717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bea47-a97e-4b86-b375-e169efc73e6a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:27.837144 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7896582-9b82-4cf4-8b02-95d23efe813c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039df81163264994a86fe2e98bb96983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:27.837757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7896582-9b82-4cf4-8b02-95d23efe813c service glance] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:27.838036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7896582-9b82-4cf4-8b02-95d23efe813c service glance] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:27.838310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7896582-9b82-4cf4-8b02-95d23efe813c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:27.847382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7896582-9b82-4cf4-8b02-95d23efe813c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:27.848783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7896582-9b82-4cf4-8b02-95d23efe813c service glance] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:27.857785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 748/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:39:30.163452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1712364-55a4-4861-9857-d91746c25156 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:30.163999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1712364-55a4-4861-9857-d91746c25156 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:30.163999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1712364-55a4-4861-9857-d91746c25156 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:30.165346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 728/1476] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:30.170462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4b384-476c-41ed-a516-aa3f0c8f04e6 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:30.170860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4b384-476c-41ed-a516-aa3f0c8f04e6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:30.171035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4b384-476c-41ed-a516-aa3f0c8f04e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:30.189082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fbb4b384-476c-41ed-a516-aa3f0c8f04e6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:30.190286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fbb4b384-476c-41ed-a516-aa3f0c8f04e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:30.197972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 749/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:30.220116 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1712364-55a4-4861-9857-d91746c25156 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:30.234300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1712364-55a4-4861-9857-d91746c25156 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:30.239200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c33b5-5a16-4257-ad32-1182b3f6f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:30.239832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c33b5-5a16-4257-ad32-1182b3f6f474 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:30.240115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c33b5-5a16-4257-ad32-1182b3f6f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:30.240385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c33b5-5a16-4257-ad32-1182b3f6f474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:30.241110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c33b5-5a16-4257-ad32-1182b3f6f474 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:30.242811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING py.warnings [None req-ea8c33b5-5a16-4257-ad32-1182b3f6f474 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:39:30.242811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: warnings.warn(msg) May 10 16:39:30.242811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: May 10 16:39:30.243970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c33b5-5a16-4257-ad32-1182b3f6f474 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:30.262107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 729/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 16:39:30 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:39:32.475707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d3dc1-bd9c-41a7-b933-472a93262c48 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:32.476287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d3dc1-bd9c-41a7-b933-472a93262c48 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:32.476403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d3dc1-bd9c-41a7-b933-472a93262c48 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:32.477721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 750/1479] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:32.482776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793c8b3-1485-46ba-b238-43f610d2cd44 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:32.483193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793c8b3-1485-46ba-b238-43f610d2cd44 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:32.483361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793c8b3-1485-46ba-b238-43f610d2cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:32.501054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-8793c8b3-1485-46ba-b238-43f610d2cd44 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:32.502228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8793c8b3-1485-46ba-b238-43f610d2cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:32.509811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 730/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:32.551234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d3dc1-bd9c-41a7-b933-472a93262c48 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:32.565056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d3dc1-bd9c-41a7-b933-472a93262c48 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:32.570343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d002b6-171c-4aad-b9fc-90849f251324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:32.570982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d002b6-171c-4aad-b9fc-90849f251324 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:32.571279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d002b6-171c-4aad-b9fc-90849f251324 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:32.571555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d002b6-171c-4aad-b9fc-90849f251324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:32.579396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d002b6-171c-4aad-b9fc-90849f251324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:32.581470 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d002b6-171c-4aad-b9fc-90849f251324 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:32.590628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 751/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:34.975584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd9191-1deb-4aae-89bc-4e57f586241f None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:34.976131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd9191-1deb-4aae-89bc-4e57f586241f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:34.976131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd9191-1deb-4aae-89bc-4e57f586241f None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:34.977477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 731/1482] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:34.982606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa4ab4-353d-43ab-a536-5e37f1ad4ebc None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:34.983100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa4ab4-353d-43ab-a536-5e37f1ad4ebc None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:34.983198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa4ab4-353d-43ab-a536-5e37f1ad4ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:35.000755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c9aa4ab4-353d-43ab-a536-5e37f1ad4ebc None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:35.001946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c9aa4ab4-353d-43ab-a536-5e37f1ad4ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:35.010265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 752/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:35.045081 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd9191-1deb-4aae-89bc-4e57f586241f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:35.056236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd9191-1deb-4aae-89bc-4e57f586241f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:35.059654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2990b41-0710-4e14-bbd7-fb1e79e08cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:35.060275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990b41-0710-4e14-bbd7-fb1e79e08cee service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:35.060555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990b41-0710-4e14-bbd7-fb1e79e08cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:35.060826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990b41-0710-4e14-bbd7-fb1e79e08cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:35.069917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2990b41-0710-4e14-bbd7-fb1e79e08cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:35.071376 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2990b41-0710-4e14-bbd7-fb1e79e08cee service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:35.080532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 732/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:37.348778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef824f-c8de-497e-9a99-f7024f4128c5 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:37.349319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef824f-c8de-497e-9a99-f7024f4128c5 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:37.349319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef824f-c8de-497e-9a99-f7024f4128c5 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:37.350705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 753/1485] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:37.355929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66dfd-0bc4-48ab-a4dc-86ffc27cacfc None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:37.356346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66dfd-0bc4-48ab-a4dc-86ffc27cacfc None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:37.356482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e66dfd-0bc4-48ab-a4dc-86ffc27cacfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:37.373949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-90e66dfd-0bc4-48ab-a4dc-86ffc27cacfc None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:37.375171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-90e66dfd-0bc4-48ab-a4dc-86ffc27cacfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:37.383466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 733/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:39:37.420455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef824f-c8de-497e-9a99-f7024f4128c5 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:37.431140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef824f-c8de-497e-9a99-f7024f4128c5 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:37.434616 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed66f12-fab3-4a68-af45-a3f5ab2b61ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:37.435286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed66f12-fab3-4a68-af45-a3f5ab2b61ac service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:37.435571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed66f12-fab3-4a68-af45-a3f5ab2b61ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:37.435864 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed66f12-fab3-4a68-af45-a3f5ab2b61ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:37.444990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed66f12-fab3-4a68-af45-a3f5ab2b61ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:37.446407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed66f12-fab3-4a68-af45-a3f5ab2b61ac service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:37.456100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 754/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:39.789459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f552c7-37e0-4a53-a56a-eddf0323b37a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:39.789996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f552c7-37e0-4a53-a56a-eddf0323b37a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:39.789996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f552c7-37e0-4a53-a56a-eddf0323b37a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:39.791384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 734/1488] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:39.796458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d817-bfd4-47f8-999c-2d1b1e3a9a7a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:39.796893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d817-bfd4-47f8-999c-2d1b1e3a9a7a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:39.796995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d817-bfd4-47f8-999c-2d1b1e3a9a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:39.814689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3eb5d817-bfd4-47f8-999c-2d1b1e3a9a7a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:39.815990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3eb5d817-bfd4-47f8-999c-2d1b1e3a9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:39.823535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 755/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:39.863136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f552c7-37e0-4a53-a56a-eddf0323b37a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:39.873391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f552c7-37e0-4a53-a56a-eddf0323b37a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:39.876862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35d77-dabc-4df3-a9b5-074e11a9504c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:39.877488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35d77-dabc-4df3-a9b5-074e11a9504c service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:39.877769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35d77-dabc-4df3-a9b5-074e11a9504c service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:39.878040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35d77-dabc-4df3-a9b5-074e11a9504c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:39.887491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d35d77-dabc-4df3-a9b5-074e11a9504c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:39.888977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d35d77-dabc-4df3-a9b5-074e11a9504c service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:39.898159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 735/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:39:42.275539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae828d-78f6-4a88-8a4c-a8d1e1523569 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:42.276119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae828d-78f6-4a88-8a4c-a8d1e1523569 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:42.276119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae828d-78f6-4a88-8a4c-a8d1e1523569 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:42.277440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 756/1491] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 16:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:42.282492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1141d-b669-4bac-9973-739339c9bcc9 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:42.282914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1141d-b669-4bac-9973-739339c9bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:42.283129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1141d-b669-4bac-9973-739339c9bcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:42.301127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-dca1141d-b669-4bac-9973-739339c9bcc9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:42.302322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-dca1141d-b669-4bac-9973-739339c9bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:42.310049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 736/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:42.352090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae828d-78f6-4a88-8a4c-a8d1e1523569 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:42.362992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae828d-78f6-4a88-8a4c-a8d1e1523569 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:42.366413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164ad9-66b6-4689-ae4f-060aaf570a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:42.367071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164ad9-66b6-4689-ae4f-060aaf570a82 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:42.367350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164ad9-66b6-4689-ae4f-060aaf570a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:42.367618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164ad9-66b6-4689-ae4f-060aaf570a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:42.376128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164ad9-66b6-4689-ae4f-060aaf570a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:42.378257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164ad9-66b6-4689-ae4f-060aaf570a82 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:42.387276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 757/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:15.897130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4981ca-a3c4-4f48-a111-0faf5d978fcb None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:15.897599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4981ca-a3c4-4f48-a111-0faf5d978fcb None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:15.897709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4981ca-a3c4-4f48-a111-0faf5d978fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:15.915592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6a4981ca-a3c4-4f48-a111-0faf5d978fcb None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:15.916758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6a4981ca-a3c4-4f48-a111-0faf5d978fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:15.925278 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 737/1494] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:15.934437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05cebf-1845-46a7-b102-fae46afec02a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:15.934904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05cebf-1845-46a7-b102-fae46afec02a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:15.935032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05cebf-1845-46a7-b102-fae46afec02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:15.952271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-be05cebf-1845-46a7-b102-fae46afec02a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:15.953432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-be05cebf-1845-46a7-b102-fae46afec02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:15.961011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 758/1495] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:15.965399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4981ca-a3c4-4f48-a111-0faf5d978fcb None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:15.975320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4981ca-a3c4-4f48-a111-0faf5d978fcb None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:15.979815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:15.980452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:15.980730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:15.981006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:15.981731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:41:15.982034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:15.983079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING py.warnings [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:41:15.983079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: warnings.warn(msg) May 10 16:41:15.983079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: May 10 16:41:15.983950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:15.995580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 738/1496] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:41:16.003304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05cebf-1845-46a7-b102-fae46afec02a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:16.012013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05cebf-1845-46a7-b102-fae46afec02a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:16.016888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:16.017520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.017794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.018068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.018747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:16.020529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING py.warnings [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:41:16.020529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: warnings.warn(msg) May 10 16:41:16.020529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: May 10 16:41:16.021729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:16.057168 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 759/1497] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:41:16 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:41:16.061224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:16.070777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8a65f-3f18-42cf-a2d7-8ab7ef89f85a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:16.123432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:16.124087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.124371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.124645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.125323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:16.127299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING py.warnings [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:41:16.127299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: warnings.warn(msg) May 10 16:41:16.127299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: May 10 16:41:16.128503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:16.149201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 739/1498] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:41:16 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:41:16.154332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:16.166883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127ccd-09a2-4a8d-9d0c-350ac8cc8f3b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:16.171834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:16.172484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.172760 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.173029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.174069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:16.175107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING py.warnings [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:41:16.175107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: warnings.warn(msg) May 10 16:41:16.175107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: May 10 16:41:16.176163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:16.189875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 760/1499] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:41:16.194171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:16.204384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac0727-e6d1-4763-9fc4-b37e92bc9437 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:16.209037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cf872-5924-45f5-8dc6-897818abda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:16.209682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf872-5924-45f5-8dc6-897818abda9b admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.209965 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf872-5924-45f5-8dc6-897818abda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.210237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf872-5924-45f5-8dc6-897818abda9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.211021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cf872-5924-45f5-8dc6-897818abda9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:16.212036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING py.warnings [None req-bb9cf872-5924-45f5-8dc6-897818abda9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:41:16.212036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: warnings.warn(msg) May 10 16:41:16.212036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: May 10 16:41:16.212916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cf872-5924-45f5-8dc6-897818abda9b admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:16.226840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 740/1500] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:41:16.230669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:16.241410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5f102-a736-4195-bf07-7147353cfdf7 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:16.247308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6ff8-f7b1-43b3-aec3-e787d89e59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:16.248466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6ff8-f7b1-43b3-aec3-e787d89e59c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.248811 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6ff8-f7b1-43b3-aec3-e787d89e59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.249197 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6ff8-f7b1-43b3-aec3-e787d89e59c0 admin admin] PATH_INFO: `/v3/projects/7e6f14b3bddf422fa318b9a3b9c279cb/users/842061e0f1c74d358cabfba868dd826f/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.263257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee6ff8-f7b1-43b3-aec3-e787d89e59c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6f14b3bddf422fa318b9a3b9c279cb, user_id=842061e0f1c74d358cabfba868dd826f, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:16.264380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING py.warnings [None req-9aee6ff8-f7b1-43b3-aec3-e787d89e59c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:41:16.264380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: warnings.warn(msg) May 10 16:41:16.264380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: May 10 16:41:16.266833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee6ff8-f7b1-43b3-aec3-e787d89e59c0 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:16.279989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 761/1501] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:41:16 2022] PUT /identity/v3/projects/7e6f14b3bddf422fa318b9a3b9c279cb/users/842061e0f1c74d358cabfba868dd826f/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:41:16.291804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701fded-3139-4a7f-aea1-dfc5f75fbeae None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.292120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701fded-3139-4a7f-aea1-dfc5f75fbeae None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.292394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701fded-3139-4a7f-aea1-dfc5f75fbeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.317375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d701fded-3139-4a7f-aea1-dfc5f75fbeae None None] MFA Rules not processed for user `842061e0f1c74d358cabfba868dd826f`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:16.318497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d701fded-3139-4a7f-aea1-dfc5f75fbeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:16.378148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 741/1502] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:41:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:16.391185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb7027-67da-4b04-9664-ad6fbd9472c4 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.392161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb7027-67da-4b04-9664-ad6fbd9472c4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.392440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb7027-67da-4b04-9664-ad6fbd9472c4 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.393809 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 762/1503] 10.222.0.57 () {54 vars in 963 bytes} [Tue May 10 16:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:16.398638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daab16d-de14-49a2-81b9-f302c1611d47 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.398928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daab16d-de14-49a2-81b9-f302c1611d47 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.399240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daab16d-de14-49a2-81b9-f302c1611d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.417374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5daab16d-de14-49a2-81b9-f302c1611d47 None None] MFA Rules not processed for user `c789864ed513471fb6b367aecf236828`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:16.418533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5daab16d-de14-49a2-81b9-f302c1611d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:16.467555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 742/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Tue May 10 16:41:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:16.475011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb7027-67da-4b04-9664-ad6fbd9472c4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:16.485412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb7027-67da-4b04-9664-ad6fbd9472c4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:16.488871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bb2d3-e808-45c3-ba89-669b731da4e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:16.489491 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb2d3-e808-45c3-ba89-669b731da4e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.489768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb2d3-e808-45c3-ba89-669b731da4e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.490038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb2d3-e808-45c3-ba89-669b731da4e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.497851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bb2d3-e808-45c3-ba89-669b731da4e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:16.499294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bb2d3-e808-45c3-ba89-669b731da4e1 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:16.508345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 763/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:41:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:16.549700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716af49-5423-45fb-8c5c-fdb0752d02b8 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.549991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716af49-5423-45fb-8c5c-fdb0752d02b8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.550298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716af49-5423-45fb-8c5c-fdb0752d02b8 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.551605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 743/1506] 10.222.0.57 () {52 vars in 829 bytes} [Tue May 10 16:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:16.555169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bb2d3-e808-45c3-ba89-669b731da4e1 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:16.613459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bb2d3-e808-45c3-ba89-669b731da4e1 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:16.617920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:16.618766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.619075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.619347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] PATH_INFO: `/v3/users/842061e0f1c74d358cabfba868dd826f` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.620510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=842061e0f1c74d358cabfba868dd826f)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:16.621515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING py.warnings [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:41:16.621515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: warnings.warn(msg) May 10 16:41:16.621515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: May 10 16:41:16.622700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:16.684740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842061e0f1c74d358cabfba868dd826f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:16.697306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842061e0f1c74d358cabfba868dd826f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:16.706889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842061e0f1c74d358cabfba868dd826f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:16.707549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842061e0f1c74d358cabfba868dd826f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:16.726570 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842061e0f1c74d358cabfba868dd826f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:16.732505 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 764/1507] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:41:16 2022] DELETE /identity/v3/users/842061e0f1c74d358cabfba868dd826f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:41:16.737495 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30bc8-4ead-470b-b900-55f184209fc4 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.737781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30bc8-4ead-470b-b900-55f184209fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.738057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30bc8-4ead-470b-b900-55f184209fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.756127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d6c30bc8-4ead-470b-b900-55f184209fc4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:16.757316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d6c30bc8-4ead-470b-b900-55f184209fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:16.820344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 744/1508] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:16.830326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:16.831769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:16.886117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5474e-578c-4baf-a553-3742a55742cd admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:16.889628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dc9ec-41f3-4bc0-a119-7ee64544be18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:16.890269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc9ec-41f3-4bc0-a119-7ee64544be18 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.890550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc9ec-41f3-4bc0-a119-7ee64544be18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.890824 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc9ec-41f3-4bc0-a119-7ee64544be18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.899490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dc9ec-41f3-4bc0-a119-7ee64544be18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:16.900904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dc9ec-41f3-4bc0-a119-7ee64544be18 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:16.909877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 765/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:17.219243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30bc8-4ead-470b-b900-55f184209fc4 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:17.221143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d6c30bc8-4ead-470b-b900-55f184209fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:17.233180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30bc8-4ead-470b-b900-55f184209fc4 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:17.238714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:17.239616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:17.239879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:17.240152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] PATH_INFO: `/v3/projects/7e6f14b3bddf422fa318b9a3b9c279cb` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:17.241331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6f14b3bddf422fa318b9a3b9c279cb)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:17.242338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING py.warnings [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:41:17.242338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: warnings.warn(msg) May 10 16:41:17.242338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: May 10 16:41:17.243583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:17.301714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6f14b3bddf422fa318b9a3b9c279cb', 'request_id': 'req-c1b192fa-13e5-42a4-8803-c47edc383918'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:17.310668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6f14b3bddf422fa318b9a3b9c279cb', 'request_id': 'req-c1b192fa-13e5-42a4-8803-c47edc383918'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:17.316479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6f14b3bddf422fa318b9a3b9c279cb', 'request_id': 'req-c1b192fa-13e5-42a4-8803-c47edc383918'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:17.334088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] The token cache is being invalidate because project 7e6f14b3bddf422fa318b9a3b9c279cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:41:17.334377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:17.335034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c1b192fa-13e5-42a4-8803-c47edc383918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:41:17.336721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 745/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:41:17 2022] DELETE /identity/v3/projects/7e6f14b3bddf422fa318b9a3b9c279cb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:42:59.389951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedf6a-ffda-40de-b5f9-5bd0ce5476fc None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:59.390554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedf6a-ffda-40de-b5f9-5bd0ce5476fc None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:59.390554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedf6a-ffda-40de-b5f9-5bd0ce5476fc None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:59.392459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:59.397403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7600-a167-4e57-b1e4-5d3c939ba4c9 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:59.397844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7600-a167-4e57-b1e4-5d3c939ba4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:59.397963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7600-a167-4e57-b1e4-5d3c939ba4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:59.415164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-101e7600-a167-4e57-b1e4-5d3c939ba4c9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:59.416354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-101e7600-a167-4e57-b1e4-5d3c939ba4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:59.482255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:42:59.527504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660248a-99fa-40a0-bf38-9166f70ba87b None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:59.527803 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660248a-99fa-40a0-bf38-9166f70ba87b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:59.528072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660248a-99fa-40a0-bf38-9166f70ba87b None None] PATH_INFO: `/v3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:59.529384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 767/1513] 10.222.0.59 () {54 vars in 925 bytes} [Tue May 10 16:42:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:42:59.535503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44eb9-65bb-4535-b7f8-9cf9780948ea None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:59.535847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44eb9-65bb-4535-b7f8-9cf9780948ea None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:59.536135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44eb9-65bb-4535-b7f8-9cf9780948ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:59.554633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-cfd44eb9-65bb-4535-b7f8-9cf9780948ea None None] MFA Rules not processed for user `63ed36df893640fc929d7953751d1116`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:59.555866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-cfd44eb9-65bb-4535-b7f8-9cf9780948ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:59.617570 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 747/1514] 10.222.0.59 () {58 vars in 1015 bytes} [Tue May 10 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:59.651126 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660248a-99fa-40a0-bf38-9166f70ba87b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:42:59.652829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4660248a-99fa-40a0-bf38-9166f70ba87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:59.724125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660248a-99fa-40a0-bf38-9166f70ba87b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:42:59.729529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a85794-6826-4885-917f-35d9a152e5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:42:59.730165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85794-6826-4885-917f-35d9a152e5a8 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:59.730449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85794-6826-4885-917f-35d9a152e5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:59.730728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a85794-6826-4885-917f-35d9a152e5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:59.739155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a85794-6826-4885-917f-35d9a152e5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:42:59.740742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a85794-6826-4885-917f-35d9a152e5a8 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:42:59.749823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 768/1515] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:43:00.647382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56b36-0fdc-45aa-ae04-d832af720b22 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:00.647967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56b36-0fdc-45aa-ae04-d832af720b22 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:00.647967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56b36-0fdc-45aa-ae04-d832af720b22 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:00.649282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 748/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:43:00.654198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd872f-a662-4bd6-9c94-24cf34db3865 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:00.654653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd872f-a662-4bd6-9c94-24cf34db3865 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:00.654763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd872f-a662-4bd6-9c94-24cf34db3865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:00.672284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-78cd872f-a662-4bd6-9c94-24cf34db3865 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:43:00.673493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-78cd872f-a662-4bd6-9c94-24cf34db3865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:00.681432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 769/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:43:00.834566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf56b36-0fdc-45aa-ae04-d832af720b22 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:43:00.849832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf56b36-0fdc-45aa-ae04-d832af720b22 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:43:00.856247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab901d3-c947-4588-afa9-85feea403de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:43:00.857033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab901d3-c947-4588-afa9-85feea403de4 service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:00.857182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab901d3-c947-4588-afa9-85feea403de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:00.857450 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab901d3-c947-4588-afa9-85feea403de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:00.867213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab901d3-c947-4588-afa9-85feea403de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:43:00.868822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab901d3-c947-4588-afa9-85feea403de4 service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:43:00.879254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 749/1518] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:43:08.572893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d7db-eaae-45dd-b1d6-7b91b5b05870 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:08.573412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d7db-eaae-45dd-b1d6-7b91b5b05870 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:08.573412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d7db-eaae-45dd-b1d6-7b91b5b05870 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:08.574748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 770/1519] 10.222.0.57 () {54 vars in 960 bytes} [Tue May 10 16:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:43:08.579870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a083e-0d69-4469-a5c0-8bd01fd90aad None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:08.580299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a083e-0d69-4469-a5c0-8bd01fd90aad None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:08.580405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a083e-0d69-4469-a5c0-8bd01fd90aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:08.597633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ee2a083e-0d69-4469-a5c0-8bd01fd90aad None None] MFA Rules not processed for user `63ed36df893640fc929d7953751d1116`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:43:08.598810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ee2a083e-0d69-4469-a5c0-8bd01fd90aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:08.607050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 750/1520] 10.222.0.57 () {58 vars in 1057 bytes} [Tue May 10 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:43:08.616121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d7db-eaae-45dd-b1d6-7b91b5b05870 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:43:08.629983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d7db-eaae-45dd-b1d6-7b91b5b05870 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:43:08.634911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbae1c-7017-411d-80bb-61dd3578d1a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ed36df893640fc929d7953751d1116', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:43:08.635562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbae1c-7017-411d-80bb-61dd3578d1a1 service placement] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:08.635845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbae1c-7017-411d-80bb-61dd3578d1a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:08.636121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbae1c-7017-411d-80bb-61dd3578d1a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:08.644208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbae1c-7017-411d-80bb-61dd3578d1a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:43:08.645791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbae1c-7017-411d-80bb-61dd3578d1a1 service placement] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:43:08.655037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 771/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:43:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:43:12.189805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833feaa6-6b18-4b21-846f-fab29a527c5a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:12.190351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833feaa6-6b18-4b21-846f-fab29a527c5a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:12.190351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833feaa6-6b18-4b21-846f-fab29a527c5a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:12.191759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:43:12.196642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785fbd4-876e-49d1-aeb1-5e2d461fa713 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:12.197056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785fbd4-876e-49d1-aeb1-5e2d461fa713 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:12.197190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785fbd4-876e-49d1-aeb1-5e2d461fa713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:12.215601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a785fbd4-876e-49d1-aeb1-5e2d461fa713 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:43:12.216790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a785fbd4-876e-49d1-aeb1-5e2d461fa713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:12.225443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:43:12.375939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833feaa6-6b18-4b21-846f-fab29a527c5a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:43:12.389876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833feaa6-6b18-4b21-846f-fab29a527c5a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:43:12.395865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b576f69-c8a9-4c44-be62-e6c21256db3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:43:12.396493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b576f69-c8a9-4c44-be62-e6c21256db3a service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:12.396773 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b576f69-c8a9-4c44-be62-e6c21256db3a service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:12.397050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b576f69-c8a9-4c44-be62-e6c21256db3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:12.404903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b576f69-c8a9-4c44-be62-e6c21256db3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:43:12.407155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b576f69-c8a9-4c44-be62-e6c21256db3a service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:43:12.416256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 752/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:43:13.305202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7b9bb-0b80-4049-9b43-9343c1c2f1f3 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:13.305778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7b9bb-0b80-4049-9b43-9343c1c2f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:13.305778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7b9bb-0b80-4049-9b43-9343c1c2f1f3 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:13.307209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:43:13.312244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38496268-e01f-49f1-810a-b9359b5d6acb None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:13.313644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38496268-e01f-49f1-810a-b9359b5d6acb None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:13.313644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38496268-e01f-49f1-810a-b9359b5d6acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:13.333124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-38496268-e01f-49f1-810a-b9359b5d6acb None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:43:13.334331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-38496268-e01f-49f1-810a-b9359b5d6acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:13.342065 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:43:13.492324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7b9bb-0b80-4049-9b43-9343c1c2f1f3 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:43:13.506305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7b9bb-0b80-4049-9b43-9343c1c2f1f3 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:43:13.511642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa4477-c92f-48d1-8698-3cc221e5720b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:43:13.512281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa4477-c92f-48d1-8698-3cc221e5720b service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:13.512564 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa4477-c92f-48d1-8698-3cc221e5720b service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:13.512837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa4477-c92f-48d1-8698-3cc221e5720b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:13.520650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa4477-c92f-48d1-8698-3cc221e5720b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:43:13.522241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa4477-c92f-48d1-8698-3cc221e5720b service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:43:13.532582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 774/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:43:17.538620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139874c-5078-4510-b3ba-1b4be656f708 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:17.539199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139874c-5078-4510-b3ba-1b4be656f708 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:17.539199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139874c-5078-4510-b3ba-1b4be656f708 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:17.540539 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:43:17.545608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f7c1-2218-495e-ac6f-654d2856f84d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:17.546039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f7c1-2218-495e-ac6f-654d2856f84d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:17.546198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f7c1-2218-495e-ac6f-654d2856f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:17.569009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-37a7f7c1-2218-495e-ac6f-654d2856f84d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:43:17.570211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-37a7f7c1-2218-495e-ac6f-654d2856f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:17.579003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:43:17.617191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139874c-5078-4510-b3ba-1b4be656f708 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:43:17.618845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a139874c-5078-4510-b3ba-1b4be656f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:17.673432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139874c-5078-4510-b3ba-1b4be656f708 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:43:17.677297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12bda-9712-4c42-8cbb-f44b3b192af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:43:17.677929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12bda-9712-4c42-8cbb-f44b3b192af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:17.678216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12bda-9712-4c42-8cbb-f44b3b192af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:17.678487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12bda-9712-4c42-8cbb-f44b3b192af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:17.688442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd12bda-9712-4c42-8cbb-f44b3b192af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:43:17.689887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd12bda-9712-4c42-8cbb-f44b3b192af8 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:43:17.699067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 755/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:43:19.914442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e418f-26f0-47f2-bb93-3c0d5e698c48 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:19.914898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e418f-26f0-47f2-bb93-3c0d5e698c48 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:19.915048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e418f-26f0-47f2-bb93-3c0d5e698c48 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:19.916366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:43:19.921501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea998c4-fb78-4596-840c-a9981560a76d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:19.922431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea998c4-fb78-4596-840c-a9981560a76d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:19.922553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea998c4-fb78-4596-840c-a9981560a76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:19.940868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-dea998c4-fb78-4596-840c-a9981560a76d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:43:19.942053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-dea998c4-fb78-4596-840c-a9981560a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:19.949749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:43:19.984054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e418f-26f0-47f2-bb93-3c0d5e698c48 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:43:19.986277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7a4e418f-26f0-47f2-bb93-3c0d5e698c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:19.998724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e418f-26f0-47f2-bb93-3c0d5e698c48 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:43:20.002763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1f31-04d1-49fb-bc99-b1a42266e9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:43:20.003431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1f31-04d1-49fb-bc99-b1a42266e9eb service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:20.003710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1f31-04d1-49fb-bc99-b1a42266e9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:20.003982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1f31-04d1-49fb-bc99-b1a42266e9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:20.012479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1f31-04d1-49fb-bc99-b1a42266e9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:43:20.013886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1f31-04d1-49fb-bc99-b1a42266e9eb service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:43:20.023006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 777/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:43:23.739712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06969a61-5d1d-4cee-8819-7acfbaeef861 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:23.740283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06969a61-5d1d-4cee-8819-7acfbaeef861 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:23.740283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06969a61-5d1d-4cee-8819-7acfbaeef861 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:23.741670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:43:23.746903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb70fc-326c-42e7-af5d-542d254a9ec6 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:23.747366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb70fc-326c-42e7-af5d-542d254a9ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:23.747501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb70fc-326c-42e7-af5d-542d254a9ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:23.766320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-89cb70fc-326c-42e7-af5d-542d254a9ec6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:43:23.767549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-89cb70fc-326c-42e7-af5d-542d254a9ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:23.775258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:43:24.054511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06969a61-5d1d-4cee-8819-7acfbaeef861 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:43:24.056256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-06969a61-5d1d-4cee-8819-7acfbaeef861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:24.110632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06969a61-5d1d-4cee-8819-7acfbaeef861 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:43:24.114042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037654-c823-4c6d-8ce4-1bd089e1faf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:43:24.114666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037654-c823-4c6d-8ce4-1bd089e1faf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:24.114944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037654-c823-4c6d-8ce4-1bd089e1faf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:24.115252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037654-c823-4c6d-8ce4-1bd089e1faf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:24.123685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037654-c823-4c6d-8ce4-1bd089e1faf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:43:24.125597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037654-c823-4c6d-8ce4-1bd089e1faf0 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:43:24.134771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 758/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:43:26.511276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00ae0-2d93-4eac-b70b-695558eea7de None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:26.511885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00ae0-2d93-4eac-b70b-695558eea7de None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:26.511885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00ae0-2d93-4eac-b70b-695558eea7de None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:26.513212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:43:26.518432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadeeed-5338-40c0-baf6-1910c8d0ca3e None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:26.518886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadeeed-5338-40c0-baf6-1910c8d0ca3e None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:26.519027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadeeed-5338-40c0-baf6-1910c8d0ca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:26.537317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1cadeeed-5338-40c0-baf6-1910c8d0ca3e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:43:26.538497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1cadeeed-5338-40c0-baf6-1910c8d0ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:26.546103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:43:26.817295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d00ae0-2d93-4eac-b70b-695558eea7de None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:43:26.818954 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-92d00ae0-2d93-4eac-b70b-695558eea7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:43:26.831599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d00ae0-2d93-4eac-b70b-695558eea7de None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:43:26.835072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e63f2b-3d0b-4477-a18d-e83c407335a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:43:26.835705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63f2b-3d0b-4477-a18d-e83c407335a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:43:26.835988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63f2b-3d0b-4477-a18d-e83c407335a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:43:26.836270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63f2b-3d0b-4477-a18d-e83c407335a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:43:26.845396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e63f2b-3d0b-4477-a18d-e83c407335a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:43:26.846808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e63f2b-3d0b-4477-a18d-e83c407335a2 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:43:26.856124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 780/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:54.970998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7106-042b-4946-beac-d08701d46c48 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:54.972084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7106-042b-4946-beac-d08701d46c48 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:54.972579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7106-042b-4946-beac-d08701d46c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.001160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-0e0c7106-042b-4946-beac-d08701d46c48 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.002728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-0e0c7106-042b-4946-beac-d08701d46c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.011139 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeac09-e8e5-48d5-bba7-6cbd6c42bbc2 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.011729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeac09-e8e5-48d5-bba7-6cbd6c42bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.011729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeac09-e8e5-48d5-bba7-6cbd6c42bbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.017404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 760/1540] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.029637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130bb2d-c565-4b4a-bea9-fd1c2052f688 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.030296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130bb2d-c565-4b4a-bea9-fd1c2052f688 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.030786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130bb2d-c565-4b4a-bea9-fd1c2052f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.039445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3bfeac09-e8e5-48d5-bba7-6cbd6c42bbc2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.039445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3bfeac09-e8e5-48d5-bba7-6cbd6c42bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.054617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 781/1541] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.060016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1130bb2d-c565-4b4a-bea9-fd1c2052f688 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.061673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1130bb2d-c565-4b4a-bea9-fd1c2052f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.064711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097526f-8472-43d2-8e5c-2107719377ad None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.065003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097526f-8472-43d2-8e5c-2107719377ad None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.065262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097526f-8472-43d2-8e5c-2107719377ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.075249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 761/1542] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:44:55.081058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130bb2d-c565-4b4a-bea9-fd1c2052f688 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.097278 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130bb2d-c565-4b4a-bea9-fd1c2052f688 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.099003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f097526f-8472-43d2-8e5c-2107719377ad None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.100254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f097526f-8472-43d2-8e5c-2107719377ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.105286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.106347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.106848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.107365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.108424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:55.108953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.110917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.111312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 782/1543] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:44:55.116366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097526f-8472-43d2-8e5c-2107719377ad None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.127129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097526f-8472-43d2-8e5c-2107719377ad None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.131908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96a29-3a28-4f5b-a436-a1350d9be849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.132605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96a29-3a28-4f5b-a436-a1350d9be849 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.132888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96a29-3a28-4f5b-a436-a1350d9be849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.133163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96a29-3a28-4f5b-a436-a1350d9be849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.133962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d96a29-3a28-4f5b-a436-a1350d9be849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:55.134208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d96a29-3a28-4f5b-a436-a1350d9be849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.135259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING py.warnings [None req-81d96a29-3a28-4f5b-a436-a1350d9be849 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:55.135259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: warnings.warn(msg) May 10 16:44:55.135259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: May 10 16:44:55.136217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d96a29-3a28-4f5b-a436-a1350d9be849 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.136692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 762/1544] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:55.145932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.154738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 783/1545] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:55.156459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894caa6-df74-4241-aec4-8b436d832a26 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.156775 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894caa6-df74-4241-aec4-8b436d832a26 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.157057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894caa6-df74-4241-aec4-8b436d832a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.174807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185393f3-5a71-4ddf-b264-7c1a012043bd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.178833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8894caa6-df74-4241-aec4-8b436d832a26 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.180143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8894caa6-df74-4241-aec4-8b436d832a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.197618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 784/1546] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:44:55.198550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce588f-7f7d-44e0-91d9-4a2a96406f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.199259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce588f-7f7d-44e0-91d9-4a2a96406f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.199539 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce588f-7f7d-44e0-91d9-4a2a96406f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.200608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894caa6-df74-4241-aec4-8b436d832a26 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.201140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce588f-7f7d-44e0-91d9-4a2a96406f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.201847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce588f-7f7d-44e0-91d9-4a2a96406f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.202887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING py.warnings [None req-07ce588f-7f7d-44e0-91d9-4a2a96406f7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:55.202887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: warnings.warn(msg) May 10 16:44:55.202887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: May 10 16:44:55.204674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce588f-7f7d-44e0-91d9-4a2a96406f7e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.220303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894caa6-df74-4241-aec4-8b436d832a26 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.235617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268927d5-dad1-4854-a995-66e1e8cadd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.236303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268927d5-dad1-4854-a995-66e1e8cadd1b admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.236582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268927d5-dad1-4854-a995-66e1e8cadd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.236853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268927d5-dad1-4854-a995-66e1e8cadd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.237550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268927d5-dad1-4854-a995-66e1e8cadd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.239501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268927d5-dad1-4854-a995-66e1e8cadd1b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.273122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 763/1547] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:44:55.274644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916c94b-e1d8-442f-abbb-9fa467fbe57b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.274940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916c94b-e1d8-442f-abbb-9fa467fbe57b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.279187 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916c94b-e1d8-442f-abbb-9fa467fbe57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.293027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 785/1548] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:55.293855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268927d5-dad1-4854-a995-66e1e8cadd1b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.304003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1916c94b-e1d8-442f-abbb-9fa467fbe57b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.305530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1916c94b-e1d8-442f-abbb-9fa467fbe57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.365904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268927d5-dad1-4854-a995-66e1e8cadd1b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.372672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fe68c-0da6-43f0-8e9d-596a64d9d064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.373423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe68c-0da6-43f0-8e9d-596a64d9d064 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.373632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe68c-0da6-43f0-8e9d-596a64d9d064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.373909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe68c-0da6-43f0-8e9d-596a64d9d064 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.374582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fe68c-0da6-43f0-8e9d-596a64d9d064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.376314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING py.warnings [None req-bb2fe68c-0da6-43f0-8e9d-596a64d9d064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:55.376314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: warnings.warn(msg) May 10 16:44:55.376314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: May 10 16:44:55.377520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fe68c-0da6-43f0-8e9d-596a64d9d064 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.380037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 764/1549] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.381300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef1ef-2722-4f13-b746-fb6bde8bf814 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.382837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef1ef-2722-4f13-b746-fb6bde8bf814 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.382837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef1ef-2722-4f13-b746-fb6bde8bf814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.398320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 786/1550] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:55.402781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5a7ef1ef-2722-4f13-b746-fb6bde8bf814 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.403882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02911-b0e5-4234-9207-52d4f039a90d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.404175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02911-b0e5-4234-9207-52d4f039a90d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.404305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5a7ef1ef-2722-4f13-b746-fb6bde8bf814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.404468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02911-b0e5-4234-9207-52d4f039a90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.422074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 765/1551] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.422074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131425-b829-4317-ad5f-12b99d2237c1 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.422074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131425-b829-4317-ad5f-12b99d2237c1 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.422074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131425-b829-4317-ad5f-12b99d2237c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.423998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-14c02911-b0e5-4234-9207-52d4f039a90d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.425468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-14c02911-b0e5-4234-9207-52d4f039a90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.433879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 787/1552] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.435636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02911-b0e5-4234-9207-52d4f039a90d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.444749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-35131425-b829-4317-ad5f-12b99d2237c1 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.444985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02911-b0e5-4234-9207-52d4f039a90d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.446061 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-35131425-b829-4317-ad5f-12b99d2237c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.450508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa750d6a-15af-49fd-a07a-98c4642c3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.451649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750d6a-15af-49fd-a07a-98c4642c3f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.451926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750d6a-15af-49fd-a07a-98c4642c3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.452195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750d6a-15af-49fd-a07a-98c4642c3f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.452885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa750d6a-15af-49fd-a07a-98c4642c3f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.454926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa750d6a-15af-49fd-a07a-98c4642c3f4b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.462306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 766/1553] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.463788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b9b1-44e1-4101-896b-0475ad01e595 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.463981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b9b1-44e1-4101-896b-0475ad01e595 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.464404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b9b1-44e1-4101-896b-0475ad01e595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.479447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 788/1554] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:55.480263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa750d6a-15af-49fd-a07a-98c4642c3f4b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.485500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e815b9b1-44e1-4101-896b-0475ad01e595 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.486898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e815b9b1-44e1-4101-896b-0475ad01e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.491673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa750d6a-15af-49fd-a07a-98c4642c3f4b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.503272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 767/1555] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.503527 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8a04a-0e5b-4c0c-a5cc-69a01583bb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.503655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815b9b1-44e1-4101-896b-0475ad01e595 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.503747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8a04a-0e5b-4c0c-a5cc-69a01583bb22 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.503747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8a04a-0e5b-4c0c-a5cc-69a01583bb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.503747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8a04a-0e5b-4c0c-a5cc-69a01583bb22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.503747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8a04a-0e5b-4c0c-a5cc-69a01583bb22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:55.503747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8a04a-0e5b-4c0c-a5cc-69a01583bb22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.503747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8a04a-0e5b-4c0c-a5cc-69a01583bb22 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.513153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815b9b1-44e1-4101-896b-0475ad01e595 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.520122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 789/1556] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:55.520122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ab7bd-1067-424a-accb-43f08dc39b64 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.520122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ab7bd-1067-424a-accb-43f08dc39b64 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.520122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ab7bd-1067-424a-accb-43f08dc39b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.523497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d40f4-e873-43c6-aa0b-917f10ef4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.524178 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d40f4-e873-43c6-aa0b-917f10ef4ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.524463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d40f4-e873-43c6-aa0b-917f10ef4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.524739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d40f4-e873-43c6-aa0b-917f10ef4ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.525533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d40f4-e873-43c6-aa0b-917f10ef4ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.527260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d40f4-e873-43c6-aa0b-917f10ef4ca3 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.536352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e95ab7bd-1067-424a-accb-43f08dc39b64 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.537217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 768/1557] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:55.537532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e95ab7bd-1067-424a-accb-43f08dc39b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.538444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3c45-694a-4b01-bef2-7acc9d0c6d4b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.538702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3c45-694a-4b01-bef2-7acc9d0c6d4b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.539020 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b3c45-694a-4b01-bef2-7acc9d0c6d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.545299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 790/1558] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.546492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4222c4f-9ab6-4603-83f9-71a59be01cdf None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.546776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4222c4f-9ab6-4603-83f9-71a59be01cdf None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.547075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4222c4f-9ab6-4603-83f9-71a59be01cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.561210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-459b3c45-694a-4b01-bef2-7acc9d0c6d4b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.562414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-459b3c45-694a-4b01-bef2-7acc9d0c6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.565158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a4222c4f-9ab6-4603-83f9-71a59be01cdf None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.566300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a4222c4f-9ab6-4603-83f9-71a59be01cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.570854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 769/1559] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.572077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b785a9-c52c-4dac-845c-60f7edaf8379 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.572359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b785a9-c52c-4dac-845c-60f7edaf8379 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.572633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b785a9-c52c-4dac-845c-60f7edaf8379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.576563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 791/1560] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.577323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4222c4f-9ab6-4603-83f9-71a59be01cdf None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.587419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4222c4f-9ab6-4603-83f9-71a59be01cdf None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.590638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-b9b785a9-c52c-4dac-845c-60f7edaf8379 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.591855 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b9b785a9-c52c-4dac-845c-60f7edaf8379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.591980 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214a7a-75b0-4564-81aa-3d0daa166db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.592567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214a7a-75b0-4564-81aa-3d0daa166db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.592845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214a7a-75b0-4564-81aa-3d0daa166db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.593118 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214a7a-75b0-4564-81aa-3d0daa166db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.593894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d214a7a-75b0-4564-81aa-3d0daa166db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.595520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d214a7a-75b0-4564-81aa-3d0daa166db6 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.599611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 770/1561] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.600819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699045b0-c856-4725-9113-204a7276f415 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.601104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699045b0-c856-4725-9113-204a7276f415 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.601379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699045b0-c856-4725-9113-204a7276f415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.608949 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 792/1562] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:55.609587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214a7a-75b0-4564-81aa-3d0daa166db6 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.618857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-699045b0-c856-4725-9113-204a7276f415 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.620055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-699045b0-c856-4725-9113-204a7276f415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.621390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214a7a-75b0-4564-81aa-3d0daa166db6 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.626426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919cf65-2abd-41e1-9590-a6b7add73e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.627094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919cf65-2abd-41e1-9590-a6b7add73e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.627375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919cf65-2abd-41e1-9590-a6b7add73e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.627649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919cf65-2abd-41e1-9590-a6b7add73e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.628334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919cf65-2abd-41e1-9590-a6b7add73e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.628480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 771/1563] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.630500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919cf65-2abd-41e1-9590-a6b7add73e19 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.631789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699045b0-c856-4725-9113-204a7276f415 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.641265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699045b0-c856-4725-9113-204a7276f415 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.645787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4174d9-5783-40a6-aa4f-e7b76bb1b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.646436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4174d9-5783-40a6-aa4f-e7b76bb1b8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.646716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4174d9-5783-40a6-aa4f-e7b76bb1b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.647125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4174d9-5783-40a6-aa4f-e7b76bb1b8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.647756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4174d9-5783-40a6-aa4f-e7b76bb1b8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.649490 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4174d9-5783-40a6-aa4f-e7b76bb1b8c8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.655794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 793/1564] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:55.656604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919cf65-2abd-41e1-9590-a6b7add73e19 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.665235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 772/1565] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:55.665235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4174d9-5783-40a6-aa4f-e7b76bb1b8c8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.673294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4174d9-5783-40a6-aa4f-e7b76bb1b8c8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.716070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919cf65-2abd-41e1-9590-a6b7add73e19 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.722052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05942387-e92e-4f91-9a4f-ff9d6aba848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.722833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942387-e92e-4f91-9a4f-ff9d6aba848a admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.723175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942387-e92e-4f91-9a4f-ff9d6aba848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.723598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942387-e92e-4f91-9a4f-ff9d6aba848a admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.724424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05942387-e92e-4f91-9a4f-ff9d6aba848a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:55.724791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05942387-e92e-4f91-9a4f-ff9d6aba848a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.726742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05942387-e92e-4f91-9a4f-ff9d6aba848a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.727987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.728681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.728963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.729372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.730103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:55.730414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.732073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.740106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 794/1566] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:55.741375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe88cf-3072-4ea3-8fa5-8754ff1c214a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.741659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe88cf-3072-4ea3-8fa5-8754ff1c214a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.741936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe88cf-3072-4ea3-8fa5-8754ff1c214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.744201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 773/1567] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:55.745165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.754680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5979c-3a14-45dc-9823-944cededfb75 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.759258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.759898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.760145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-eebe88cf-3072-4ea3-8fa5-8754ff1c214a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:55.760278 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.760441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.761157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:55.761358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-eebe88cf-3072-4ea3-8fa5-8754ff1c214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:55.761466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.763126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.769630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 795/1568] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:55.770394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe88cf-3072-4ea3-8fa5-8754ff1c214a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.775541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 774/1569] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:55.776214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.785067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe88cf-3072-4ea3-8fa5-8754ff1c214a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.785991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcccfc-5819-4e3c-804c-bff7a18622f1 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.789943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf73e0-aeb2-4c50-a682-e89d178518cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.790501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf73e0-aeb2-4c50-a682-e89d178518cb admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.790718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.790845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf73e0-aeb2-4c50-a682-e89d178518cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.791111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf73e0-aeb2-4c50-a682-e89d178518cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.791383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.791664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.791837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf73e0-aeb2-4c50-a682-e89d178518cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.791939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.792640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:55.792946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.793428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf73e0-aeb2-4c50-a682-e89d178518cb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.794636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.804018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 796/1570] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:55.804781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf73e0-aeb2-4c50-a682-e89d178518cb admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.807952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 775/1571] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:55.807952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.817272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744a8de-c51b-46da-8c8e-bb882d5fc47d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.818433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf73e0-aeb2-4c50-a682-e89d178518cb admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.821825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.822678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.822858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71263a-1770-4298-98c1-034666d9bcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.823045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.823266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] PATH_INFO: `/v3/projects/6d32f3859d964423a98c13e212e34a5b/users/fde21cc42af64e03b9390ff82511035d/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.823558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71263a-1770-4298-98c1-034666d9bcc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.823822 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71263a-1770-4298-98c1-034666d9bcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.824099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71263a-1770-4298-98c1-034666d9bcc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.824778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71263a-1770-4298-98c1-034666d9bcc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.826682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71263a-1770-4298-98c1-034666d9bcc4 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.837409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d32f3859d964423a98c13e212e34a5b, user_id=fde21cc42af64e03b9390ff82511035d, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.838454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING py.warnings [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:55.838454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: warnings.warn(msg) May 10 16:44:55.838454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: May 10 16:44:55.840426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.847161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 797/1572] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/users => generated 282 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:55.847925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71263a-1770-4298-98c1-034666d9bcc4 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.853268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 776/1573] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:55 2022] PUT /identity/v3/projects/6d32f3859d964423a98c13e212e34a5b/users/fde21cc42af64e03b9390ff82511035d/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:55.854087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.859415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71263a-1770-4298-98c1-034666d9bcc4 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.916777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2129662-5f7a-4bb6-8fdb-54ac76802a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.917439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2129662-5f7a-4bb6-8fdb-54ac76802a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.917718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2129662-5f7a-4bb6-8fdb-54ac76802a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.917991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2129662-5f7a-4bb6-8fdb-54ac76802a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.918706 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2129662-5f7a-4bb6-8fdb-54ac76802a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.919975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfa681-a9c4-43d5-91cb-ca99b0df04bf admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:55.920724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2129662-5f7a-4bb6-8fdb-54ac76802a54 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.925511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f9e61-5ea7-4b80-ad5d-35534dcc1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:55.926165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9e61-5ea7-4b80-ad5d-35534dcc1117 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:55.926448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9e61-5ea7-4b80-ad5d-35534dcc1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:55.926723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9e61-5ea7-4b80-ad5d-35534dcc1117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:55.927439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f9e61-5ea7-4b80-ad5d-35534dcc1117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:55.929335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f9e61-5ea7-4b80-ad5d-35534dcc1117 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:55.946928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 798/1574] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:55.948204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2129662-5f7a-4bb6-8fdb-54ac76802a54 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:55.956822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 777/1575] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:55.957736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f9e61-5ea7-4b80-ad5d-35534dcc1117 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.007413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2129662-5f7a-4bb6-8fdb-54ac76802a54 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.017659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f9e61-5ea7-4b80-ad5d-35534dcc1117 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.022186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144b32-9997-44aa-959c-3b710057372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.022839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144b32-9997-44aa-959c-3b710057372f admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.023157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144b32-9997-44aa-959c-3b710057372f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.023437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144b32-9997-44aa-959c-3b710057372f admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.024121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37144b32-9997-44aa-959c-3b710057372f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.026031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37144b32-9997-44aa-959c-3b710057372f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.053489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 778/1576] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:55 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:56.054615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144b32-9997-44aa-959c-3b710057372f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.063744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.064415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.064697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.064978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.065707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:56.066015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.067699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.078827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 799/1577] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:56.079711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.095700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e98ddd-af92-4a67-ac8a-e33df5315921 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.115817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144b32-9997-44aa-959c-3b710057372f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.120258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9eec-6067-46b3-9f4a-5bd3a1f4376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.121128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9eec-6067-46b3-9f4a-5bd3a1f4376f admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.121403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9eec-6067-46b3-9f4a-5bd3a1f4376f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.121677 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9eec-6067-46b3-9f4a-5bd3a1f4376f admin admin] PATH_INFO: `/v3/projects/f97b3ffb197e43f3b3d839655c932d07/users/12295672982a4855b09a742cc5a2d860/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.135740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e9eec-6067-46b3-9f4a-5bd3a1f4376f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97b3ffb197e43f3b3d839655c932d07, user_id=12295672982a4855b09a742cc5a2d860, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.138375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e9eec-6067-46b3-9f4a-5bd3a1f4376f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.150409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f350454-8a65-437e-8a7d-89fab3454e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.151024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f350454-8a65-437e-8a7d-89fab3454e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.151313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f350454-8a65-437e-8a7d-89fab3454e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.151591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f350454-8a65-437e-8a7d-89fab3454e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.152338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f350454-8a65-437e-8a7d-89fab3454e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.163525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 779/1578] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:56 2022] PUT /identity/v3/projects/f97b3ffb197e43f3b3d839655c932d07/users/12295672982a4855b09a742cc5a2d860/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:56.163525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9eec-6067-46b3-9f4a-5bd3a1f4376f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.163791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f350454-8a65-437e-8a7d-89fab3454e6d admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.182580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 800/1579] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:56.182580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737fa1d-f65c-4281-9567-5b2ae16b54a4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.182580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737fa1d-f65c-4281-9567-5b2ae16b54a4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.182580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737fa1d-f65c-4281-9567-5b2ae16b54a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.209546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e737fa1d-f65c-4281-9567-5b2ae16b54a4 None None] MFA Rules not processed for user `fde21cc42af64e03b9390ff82511035d`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:56.210839 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e737fa1d-f65c-4281-9567-5b2ae16b54a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:56.223834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9eec-6067-46b3-9f4a-5bd3a1f4376f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.273732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 801/1580] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:56.274627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737fa1d-f65c-4281-9567-5b2ae16b54a4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.280549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732f770-6bea-440c-bf6f-62cfc5deda80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.281307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f770-6bea-440c-bf6f-62cfc5deda80 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.281611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f770-6bea-440c-bf6f-62cfc5deda80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.282796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f770-6bea-440c-bf6f-62cfc5deda80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.283686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732f770-6bea-440c-bf6f-62cfc5deda80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.285337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732f770-6bea-440c-bf6f-62cfc5deda80 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.298218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 780/1581] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.298218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732f770-6bea-440c-bf6f-62cfc5deda80 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.305290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732f770-6bea-440c-bf6f-62cfc5deda80 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.309661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1fa4-3fba-4733-82ac-8b1ef66702e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.310282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1fa4-3fba-4733-82ac-8b1ef66702e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.310559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1fa4-3fba-4733-82ac-8b1ef66702e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.310829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1fa4-3fba-4733-82ac-8b1ef66702e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.311524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf1fa4-3fba-4733-82ac-8b1ef66702e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.313702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf1fa4-3fba-4733-82ac-8b1ef66702e9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.337356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 781/1582] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/users => generated 289 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:56.337722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737fa1d-f65c-4281-9567-5b2ae16b54a4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.338196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1fa4-3fba-4733-82ac-8b1ef66702e9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.342235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cfb1e-9c0f-4d9b-887f-a0564eb68d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.342902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cfb1e-9c0f-4d9b-887f-a0564eb68d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.343222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cfb1e-9c0f-4d9b-887f-a0564eb68d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.343498 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cfb1e-9c0f-4d9b-887f-a0564eb68d53 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.344213 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cfb1e-9c0f-4d9b-887f-a0564eb68d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.346751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cfb1e-9c0f-4d9b-887f-a0564eb68d53 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.348084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1fa4-3fba-4733-82ac-8b1ef66702e9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.352529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0ec3b-de68-463f-91fc-316977d3dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.353190 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ec3b-de68-463f-91fc-316977d3dc58 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.353470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ec3b-de68-463f-91fc-316977d3dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.353739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0ec3b-de68-463f-91fc-316977d3dc58 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.354401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0ec3b-de68-463f-91fc-316977d3dc58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.356517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0ec3b-de68-463f-91fc-316977d3dc58 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.365980 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 802/1583] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:56.367469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cfb1e-9c0f-4d9b-887f-a0564eb68d53 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.377399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cfb1e-9c0f-4d9b-887f-a0564eb68d53 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.379223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 782/1584] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:56.380304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19d62-af23-4cf1-92eb-060f6919ab1b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.380585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19d62-af23-4cf1-92eb-060f6919ab1b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.380857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19d62-af23-4cf1-92eb-060f6919ab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.384917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe14b1-cf29-42e1-96e4-0e03668df81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.385589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe14b1-cf29-42e1-96e4-0e03668df81b admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.385872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe14b1-cf29-42e1-96e4-0e03668df81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.386147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe14b1-cf29-42e1-96e4-0e03668df81b admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.386831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe14b1-cf29-42e1-96e4-0e03668df81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.388756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe14b1-cf29-42e1-96e4-0e03668df81b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.405669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-0bc19d62-af23-4cf1-92eb-060f6919ab1b None None] MFA Rules not processed for user `12295672982a4855b09a742cc5a2d860`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:56.407555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-0bc19d62-af23-4cf1-92eb-060f6919ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:56.418171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 803/1585] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:56.418171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe14b1-cf29-42e1-96e4-0e03668df81b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.471381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 783/1586] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:56.472410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19d62-af23-4cf1-92eb-060f6919ab1b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.476557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe14b1-cf29-42e1-96e4-0e03668df81b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.481149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266b8cd-b660-4e99-8b69-d3813a8bb269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.482003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b8cd-b660-4e99-8b69-d3813a8bb269 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.482387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b8cd-b660-4e99-8b69-d3813a8bb269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.482760 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266b8cd-b660-4e99-8b69-d3813a8bb269 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.483699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266b8cd-b660-4e99-8b69-d3813a8bb269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.485761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266b8cd-b660-4e99-8b69-d3813a8bb269 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.508563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 804/1587] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:56.508563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266b8cd-b660-4e99-8b69-d3813a8bb269 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.518048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266b8cd-b660-4e99-8b69-d3813a8bb269 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.522496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b7d84-a8ae-4ae2-94e7-55eae1d8cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.523173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b7d84-a8ae-4ae2-94e7-55eae1d8cda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.523454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b7d84-a8ae-4ae2-94e7-55eae1d8cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.523724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b7d84-a8ae-4ae2-94e7-55eae1d8cda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.524431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b7d84-a8ae-4ae2-94e7-55eae1d8cda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.526004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b7d84-a8ae-4ae2-94e7-55eae1d8cda8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.532480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19d62-af23-4cf1-92eb-060f6919ab1b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.535766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 805/1588] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.536572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b7d84-a8ae-4ae2-94e7-55eae1d8cda8 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.546497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b7d84-a8ae-4ae2-94e7-55eae1d8cda8 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.551298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a1deb-c7b0-4731-bcb3-9f7f125648cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.551928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a1deb-c7b0-4731-bcb3-9f7f125648cb admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.552204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a1deb-c7b0-4731-bcb3-9f7f125648cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.552476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a1deb-c7b0-4731-bcb3-9f7f125648cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.553180 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a1deb-c7b0-4731-bcb3-9f7f125648cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.554744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a1deb-c7b0-4731-bcb3-9f7f125648cb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.565155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 806/1589] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.565921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a1deb-c7b0-4731-bcb3-9f7f125648cb admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.576307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a1deb-c7b0-4731-bcb3-9f7f125648cb admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.581510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dfc8d-1eab-4336-bdb9-ea5083f22798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.581781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9eee1-9535-417b-91a8-8eaf3c1fe9c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.582162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dfc8d-1eab-4336-bdb9-ea5083f22798 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.582417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9eee1-9535-417b-91a8-8eaf3c1fe9c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.582532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dfc8d-1eab-4336-bdb9-ea5083f22798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.582696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9eee1-9535-417b-91a8-8eaf3c1fe9c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.582799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dfc8d-1eab-4336-bdb9-ea5083f22798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.582989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9eee1-9535-417b-91a8-8eaf3c1fe9c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.583442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dfc8d-1eab-4336-bdb9-ea5083f22798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.584978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dfc8d-1eab-4336-bdb9-ea5083f22798 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.594656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 807/1590] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.595456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dfc8d-1eab-4336-bdb9-ea5083f22798 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.604269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dfc8d-1eab-4336-bdb9-ea5083f22798 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.608985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9641c-14aa-4a00-8683-aed6b464f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.609722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9641c-14aa-4a00-8683-aed6b464f503 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.610012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9641c-14aa-4a00-8683-aed6b464f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.610289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9641c-14aa-4a00-8683-aed6b464f503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.611050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9641c-14aa-4a00-8683-aed6b464f503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.612620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9641c-14aa-4a00-8683-aed6b464f503 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.622091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 808/1591] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.622917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9641c-14aa-4a00-8683-aed6b464f503 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.632656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9641c-14aa-4a00-8683-aed6b464f503 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.636925 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9eee1-9535-417b-91a8-8eaf3c1fe9c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.637196 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eefc7-0c06-4ad6-b65d-d38f3cad7abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.637821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eefc7-0c06-4ad6-b65d-d38f3cad7abe admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.638105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eefc7-0c06-4ad6-b65d-d38f3cad7abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.638365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9eee1-9535-417b-91a8-8eaf3c1fe9c6 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.638486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eefc7-0c06-4ad6-b65d-d38f3cad7abe admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.639064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88eefc7-0c06-4ad6-b65d-d38f3cad7abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.640959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88eefc7-0c06-4ad6-b65d-d38f3cad7abe admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.647914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 784/1592] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:56.649636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda56d6-5a3a-44d3-bfbc-bb7f418bed3a None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.650081 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda56d6-5a3a-44d3-bfbc-bb7f418bed3a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.650508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda56d6-5a3a-44d3-bfbc-bb7f418bed3a None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.652079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 785/1593] 10.222.0.57 () {54 vars in 961 bytes} [Tue May 10 16:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:44:56.657807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda56d6-5a3a-44d3-bfbc-bb7f418bed3a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.665260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 809/1594] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:56.665260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eefc7-0c06-4ad6-b65d-d38f3cad7abe admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.671160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda56d6-5a3a-44d3-bfbc-bb7f418bed3a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.673075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eefc7-0c06-4ad6-b65d-d38f3cad7abe admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.675990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529823-ed38-4a35-9f7c-f9040541768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.676644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529823-ed38-4a35-9f7c-f9040541768a admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.676917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529823-ed38-4a35-9f7c-f9040541768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.677193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529823-ed38-4a35-9f7c-f9040541768a admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.677918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529823-ed38-4a35-9f7c-f9040541768a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.678345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695060f-1936-4f08-b801-d5ef955dcce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.679253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695060f-1936-4f08-b801-d5ef955dcce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.679536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695060f-1936-4f08-b801-d5ef955dcce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.679676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529823-ed38-4a35-9f7c-f9040541768a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.679870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695060f-1936-4f08-b801-d5ef955dcce8 admin admin] PATH_INFO: `/v3/projects/32b54a160e0b4cfd993ea9fad29b8b3a/users/ab008506d8944c94b018d239abfcbc4f/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.690327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 786/1595] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.691212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529823-ed38-4a35-9f7c-f9040541768a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.696501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695060f-1936-4f08-b801-d5ef955dcce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b54a160e0b4cfd993ea9fad29b8b3a, user_id=ab008506d8944c94b018d239abfcbc4f, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.699207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695060f-1936-4f08-b801-d5ef955dcce8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.700396 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529823-ed38-4a35-9f7c-f9040541768a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.705660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9cf9-0ba2-4546-b635-fddaa8412a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.706307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9cf9-0ba2-4546-b635-fddaa8412a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.706571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9cf9-0ba2-4546-b635-fddaa8412a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.706849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9cf9-0ba2-4546-b635-fddaa8412a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.707627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d9cf9-0ba2-4546-b635-fddaa8412a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.709188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d9cf9-0ba2-4546-b635-fddaa8412a8f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.725038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 810/1596] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:56 2022] PUT /identity/v3/projects/32b54a160e0b4cfd993ea9fad29b8b3a/users/ab008506d8944c94b018d239abfcbc4f/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:56.725038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695060f-1936-4f08-b801-d5ef955dcce8 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.725486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 787/1597] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.725486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9cf9-0ba2-4546-b635-fddaa8412a8f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.731250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9cf9-0ba2-4546-b635-fddaa8412a8f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.786878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695060f-1936-4f08-b801-d5ef955dcce8 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.791603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf826-063e-42b4-b8a6-b61d0b3469dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.792265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf826-063e-42b4-b8a6-b61d0b3469dd admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.793017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf826-063e-42b4-b8a6-b61d0b3469dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.793017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf826-063e-42b4-b8a6-b61d0b3469dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.793516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf826-063e-42b4-b8a6-b61d0b3469dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.794589 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8888a5-9fee-43cc-b42b-aaa5ba4a878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.795138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf826-063e-42b4-b8a6-b61d0b3469dd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.795554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8888a5-9fee-43cc-b42b-aaa5ba4a878a admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.795910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8888a5-9fee-43cc-b42b-aaa5ba4a878a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.796390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8888a5-9fee-43cc-b42b-aaa5ba4a878a admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.797226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8888a5-9fee-43cc-b42b-aaa5ba4a878a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.799324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8888a5-9fee-43cc-b42b-aaa5ba4a878a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.805691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 788/1598] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.806986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac5b36-a3c3-4f91-b174-33eac217b055 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.807343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac5b36-a3c3-4f91-b174-33eac217b055 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.807615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac5b36-a3c3-4f91-b174-33eac217b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.813676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 811/1599] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.813676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8888a5-9fee-43cc-b42b-aaa5ba4a878a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.824170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8888a5-9fee-43cc-b42b-aaa5ba4a878a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.830074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefb3c2-a8c5-4248-a701-25b5c397e387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.830773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefb3c2-a8c5-4248-a701-25b5c397e387 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.831111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefb3c2-a8c5-4248-a701-25b5c397e387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.831400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefb3c2-a8c5-4248-a701-25b5c397e387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.832155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefb3c2-a8c5-4248-a701-25b5c397e387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.833065 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-a2ac5b36-a3c3-4f91-b174-33eac217b055 None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:56.833774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefb3c2-a8c5-4248-a701-25b5c397e387 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.834698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a2ac5b36-a3c3-4f91-b174-33eac217b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:56.844845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 812/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.845808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefb3c2-a8c5-4248-a701-25b5c397e387 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.856235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefb3c2-a8c5-4248-a701-25b5c397e387 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.861723 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acfaf-31b0-496f-b94a-0564aacd1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.862410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acfaf-31b0-496f-b94a-0564aacd1978 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.862692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acfaf-31b0-496f-b94a-0564aacd1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.863001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acfaf-31b0-496f-b94a-0564aacd1978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.863746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1acfaf-31b0-496f-b94a-0564aacd1978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.865375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1acfaf-31b0-496f-b94a-0564aacd1978 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.883104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 813/1601] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:56.887365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acfaf-31b0-496f-b94a-0564aacd1978 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.898182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acfaf-31b0-496f-b94a-0564aacd1978 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:56.903018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d8c9-ed52-4193-82bf-4f57fd3ff20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:56.903930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d8c9-ed52-4193-82bf-4f57fd3ff20c admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.904211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d8c9-ed52-4193-82bf-4f57fd3ff20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.904508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d8c9-ed52-4193-82bf-4f57fd3ff20c admin admin] PATH_INFO: `/v3/projects/e62efa049c3d42a58322385ec167719c/users/e7e31bed346e408e8499bcc6a3397a82/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.919266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 789/1602] 10.222.0.57 () {58 vars in 1058 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:56.919765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d8c9-ed52-4193-82bf-4f57fd3ff20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62efa049c3d42a58322385ec167719c, user_id=e7e31bed346e408e8499bcc6a3397a82, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:56.920811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fcd5-24a0-4d57-8a92-d6548ea39fa2 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:56.921258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fcd5-24a0-4d57-8a92-d6548ea39fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:56.921568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fcd5-24a0-4d57-8a92-d6548ea39fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:56.923074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d8c9-ed52-4193-82bf-4f57fd3ff20c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:56.943344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 814/1603] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:56 2022] PUT /identity/v3/projects/e62efa049c3d42a58322385ec167719c/users/e7e31bed346e408e8499bcc6a3397a82/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:56.943344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d8c9-ed52-4193-82bf-4f57fd3ff20c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:56.951925 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d9d4fcd5-24a0-4d57-8a92-d6548ea39fa2 None None] MFA Rules not processed for user `ab008506d8944c94b018d239abfcbc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:56.953253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d9d4fcd5-24a0-4d57-8a92-d6548ea39fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:57.007132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d8c9-ed52-4193-82bf-4f57fd3ff20c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.011623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a761-f2e4-4f19-8666-5fac4bd116b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.012459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a761-f2e4-4f19-8666-5fac4bd116b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.012740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a761-f2e4-4f19-8666-5fac4bd116b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.013005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a761-f2e4-4f19-8666-5fac4bd116b2 admin admin] PATH_INFO: `/v3/projects/0023ae114cd946e4ac28f88c66b591cb/users/d61e26de3ae84980bca0da75ef882096/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.026309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 790/1604] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:57.030220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a761-f2e4-4f19-8666-5fac4bd116b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0023ae114cd946e4ac28f88c66b591cb, user_id=d61e26de3ae84980bca0da75ef882096, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.030839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4fcd5-24a0-4d57-8a92-d6548ea39fa2 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.033106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a761-f2e4-4f19-8666-5fac4bd116b2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.041676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4fcd5-24a0-4d57-8a92-d6548ea39fa2 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.048740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 815/1605] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:56 2022] PUT /identity/v3/projects/0023ae114cd946e4ac28f88c66b591cb/users/d61e26de3ae84980bca0da75ef882096/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:57.049685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a761-f2e4-4f19-8666-5fac4bd116b2 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.101961 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa37362-d40a-4f8a-b927-c6cea411724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.103006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa37362-d40a-4f8a-b927-c6cea411724d admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.103456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa37362-d40a-4f8a-b927-c6cea411724d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.103707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa37362-d40a-4f8a-b927-c6cea411724d admin admin] PATH_INFO: `/v3/projects/3dbc7e862c11480e96d2804301e9796b/users/48a7478e69d740e89da1201c954cbfe0/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.114419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a761-f2e4-4f19-8666-5fac4bd116b2 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.119170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e8b6-f92c-487b-ad6f-7112a1d9b0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.119958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e8b6-f92c-487b-ad6f-7112a1d9b0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.120306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e8b6-f92c-487b-ad6f-7112a1d9b0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.120599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa37362-d40a-4f8a-b927-c6cea411724d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbc7e862c11480e96d2804301e9796b, user_id=48a7478e69d740e89da1201c954cbfe0, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.120724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143e8b6-f92c-487b-ad6f-7112a1d9b0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.121470 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e8b6-f92c-487b-ad6f-7112a1d9b0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.123193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143e8b6-f92c-487b-ad6f-7112a1d9b0d7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.123706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa37362-d40a-4f8a-b927-c6cea411724d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.134434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 816/1606] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:57.135391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e8b6-f92c-487b-ad6f-7112a1d9b0d7 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.139621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 791/1607] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:57 2022] PUT /identity/v3/projects/3dbc7e862c11480e96d2804301e9796b/users/48a7478e69d740e89da1201c954cbfe0/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:57.140686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa37362-d40a-4f8a-b927-c6cea411724d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.145898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143e8b6-f92c-487b-ad6f-7112a1d9b0d7 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.215490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431441cb-d464-4ba4-b9f6-2f6597f2f0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.216329 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431441cb-d464-4ba4-b9f6-2f6597f2f0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.216611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431441cb-d464-4ba4-b9f6-2f6597f2f0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.216887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431441cb-d464-4ba4-b9f6-2f6597f2f0a5 admin admin] PATH_INFO: `/v3/projects/c0da2d582ad649208e7c4105faee8290/users/de5e76d5385f44fab03527751a478f1e/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.227343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa37362-d40a-4f8a-b927-c6cea411724d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.233818 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431441cb-d464-4ba4-b9f6-2f6597f2f0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0da2d582ad649208e7c4105faee8290, user_id=de5e76d5385f44fab03527751a478f1e, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.234192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561195-e881-4dd1-ab32-a836bc5fe96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.234915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561195-e881-4dd1-ab32-a836bc5fe96a service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.235735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561195-e881-4dd1-ab32-a836bc5fe96a service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.236129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561195-e881-4dd1-ab32-a836bc5fe96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.237346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431441cb-d464-4ba4-b9f6-2f6597f2f0a5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.256424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 817/1608] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:57 2022] PUT /identity/v3/projects/c0da2d582ad649208e7c4105faee8290/users/de5e76d5385f44fab03527751a478f1e/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:57.257294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e47c-2264-42c9-ab74-b4a89d6c9698 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.258074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e47c-2264-42c9-ab74-b4a89d6c9698 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.258074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584e47c-2264-42c9-ab74-b4a89d6c9698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.277768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-0584e47c-2264-42c9-ab74-b4a89d6c9698 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:57.278210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0584e47c-2264-42c9-ab74-b4a89d6c9698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:57.302039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50561195-e881-4dd1-ab32-a836bc5fe96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.304661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50561195-e881-4dd1-ab32-a836bc5fe96a service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.317110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 792/1609] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:57.324230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561195-e881-4dd1-ab32-a836bc5fe96a service nova] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.338923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561195-e881-4dd1-ab32-a836bc5fe96a service nova] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.343835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 818/1610] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:57.343835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0f55-3022-4230-910d-a1e879d8e647 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.343835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0f55-3022-4230-910d-a1e879d8e647 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.343835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0f55-3022-4230-910d-a1e879d8e647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.351719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c41689-d2eb-41ab-af15-32bb661ab680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.352630 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c41689-d2eb-41ab-af15-32bb661ab680 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.352920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c41689-d2eb-41ab-af15-32bb661ab680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.353198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c41689-d2eb-41ab-af15-32bb661ab680 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.353892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c41689-d2eb-41ab-af15-32bb661ab680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.356277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c41689-d2eb-41ab-af15-32bb661ab680 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.373011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-486b0f55-3022-4230-910d-a1e879d8e647 None None] MFA Rules not processed for user `d61e26de3ae84980bca0da75ef882096`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:57.374295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-486b0f55-3022-4230-910d-a1e879d8e647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:57.390425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 793/1611] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:57.391920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c41689-d2eb-41ab-af15-32bb661ab680 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.444690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 819/1612] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:57.446171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b1f4f-d5e2-4589-b026-4c8e4b597493 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.446557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b1f4f-d5e2-4589-b026-4c8e4b597493 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.446930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b1f4f-d5e2-4589-b026-4c8e4b597493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.466478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-535b1f4f-d5e2-4589-b026-4c8e4b597493 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:57.467635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-535b1f4f-d5e2-4589-b026-4c8e4b597493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:57.468505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c41689-d2eb-41ab-af15-32bb661ab680 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.473271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3baec-f8fa-43c6-b7ce-ce581961f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.474210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3baec-f8fa-43c6-b7ce-ce581961f280 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.474558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3baec-f8fa-43c6-b7ce-ce581961f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.474906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3baec-f8fa-43c6-b7ce-ce581961f280 admin admin] PATH_INFO: `/v3/projects/84172cfab2284ba996a1bac10e937022/users/0a6bd960c8a34c0b87342e82cebac065/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.477204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 820/1613] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:57.479120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909a253-c387-4784-9e0a-b36de3de1338 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.479120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909a253-c387-4784-9e0a-b36de3de1338 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.479120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909a253-c387-4784-9e0a-b36de3de1338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.499873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1909a253-c387-4784-9e0a-b36de3de1338 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:57.500295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3baec-f8fa-43c6-b7ce-ce581961f280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84172cfab2284ba996a1bac10e937022, user_id=0a6bd960c8a34c0b87342e82cebac065, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.501798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1909a253-c387-4784-9e0a-b36de3de1338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:57.504018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3baec-f8fa-43c6-b7ce-ce581961f280 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.510870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 821/1614] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:57.511967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909a253-c387-4784-9e0a-b36de3de1338 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.521151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 794/1615] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:57 2022] PUT /identity/v3/projects/84172cfab2284ba996a1bac10e937022/users/0a6bd960c8a34c0b87342e82cebac065/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:57.523429 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3baec-f8fa-43c6-b7ce-ce581961f280 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.570386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909a253-c387-4784-9e0a-b36de3de1338 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.593999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3baec-f8fa-43c6-b7ce-ce581961f280 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.598672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd9c7-b71e-4930-be0c-14652a83db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.599372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd9c7-b71e-4930-be0c-14652a83db5f admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.599656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd9c7-b71e-4930-be0c-14652a83db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.599934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd9c7-b71e-4930-be0c-14652a83db5f admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.600615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dd9c7-b71e-4930-be0c-14652a83db5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.602538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dd9c7-b71e-4930-be0c-14652a83db5f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.618530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99a757-7a63-4ea1-b36a-58e594e59789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.619208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99a757-7a63-4ea1-b36a-58e594e59789 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.619492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99a757-7a63-4ea1-b36a-58e594e59789 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.619767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99a757-7a63-4ea1-b36a-58e594e59789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.623204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 795/1616] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:57.624245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd9c7-b71e-4930-be0c-14652a83db5f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.629531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99a757-7a63-4ea1-b36a-58e594e59789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.630981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99a757-7a63-4ea1-b36a-58e594e59789 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.634307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd9c7-b71e-4930-be0c-14652a83db5f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.638815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc2510-50d8-497a-84a7-3893a5eee766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.639470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2510-50d8-497a-84a7-3893a5eee766 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.639757 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2510-50d8-497a-84a7-3893a5eee766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.640038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2510-50d8-497a-84a7-3893a5eee766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.640172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 822/1617] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:57.640785 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc2510-50d8-497a-84a7-3893a5eee766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.640927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99a757-7a63-4ea1-b36a-58e594e59789 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.642793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc2510-50d8-497a-84a7-3893a5eee766 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.648428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99a757-7a63-4ea1-b36a-58e594e59789 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.652698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e5668-e6e5-4188-8396-5b0b48b03a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.653330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e5668-e6e5-4188-8396-5b0b48b03a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.653616 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e5668-e6e5-4188-8396-5b0b48b03a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.653893 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e5668-e6e5-4188-8396-5b0b48b03a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.664044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e5668-e6e5-4188-8396-5b0b48b03a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.665640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e5668-e6e5-4188-8396-5b0b48b03a5b service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.671479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 796/1618] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:57.672839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc2510-50d8-497a-84a7-3893a5eee766 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.680099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 823/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:57.681552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3c6e0-10d7-44d3-8c2b-5b0c71a2c7e1 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.681832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3c6e0-10d7-44d3-8c2b-5b0c71a2c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.682117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3c6e0-10d7-44d3-8c2b-5b0c71a2c7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.709233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a5a3c6e0-10d7-44d3-8c2b-5b0c71a2c7e1 None None] MFA Rules not processed for user `0a6bd960c8a34c0b87342e82cebac065`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:57.710457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a5a3c6e0-10d7-44d3-8c2b-5b0c71a2c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:57.727707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc2510-50d8-497a-84a7-3893a5eee766 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.731759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930444a-5212-4b71-9f52-c2aca2771e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.732372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930444a-5212-4b71-9f52-c2aca2771e39 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.732714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930444a-5212-4b71-9f52-c2aca2771e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.732930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930444a-5212-4b71-9f52-c2aca2771e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.787440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 824/1620] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:57.788911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de76ce-3945-4c4d-a988-2beb338b0a64 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.789202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de76ce-3945-4c4d-a988-2beb338b0a64 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.789484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de76ce-3945-4c4d-a988-2beb338b0a64 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.790950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 825/1621] 10.222.0.57 () {54 vars in 912 bytes} [Tue May 10 16:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:44:57.791704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de76ce-3945-4c4d-a988-2beb338b0a64 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.805376 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930444a-5212-4b71-9f52-c2aca2771e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.807226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930444a-5212-4b71-9f52-c2aca2771e39 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.819918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 797/1622] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:57.820964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930444a-5212-4b71-9f52-c2aca2771e39 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.831125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930444a-5212-4b71-9f52-c2aca2771e39 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.836466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceba4ed-4282-4f7c-a9d9-ef989a45fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.837134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba4ed-4282-4f7c-a9d9-ef989a45fd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.837418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba4ed-4282-4f7c-a9d9-ef989a45fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.837741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceba4ed-4282-4f7c-a9d9-ef989a45fd77 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.838425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceba4ed-4282-4f7c-a9d9-ef989a45fd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.840389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceba4ed-4282-4f7c-a9d9-ef989a45fd77 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.863562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 798/1623] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:57.865566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661cb2-5644-42ed-8e42-7c1e31c082a6 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.866151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661cb2-5644-42ed-8e42-7c1e31c082a6 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.866301 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5661cb2-5644-42ed-8e42-7c1e31c082a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.867627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de76ce-3945-4c4d-a988-2beb338b0a64 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.877844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fb0e7-8c48-4329-a87f-d1a6d0db02c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.878677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fb0e7-8c48-4329-a87f-d1a6d0db02c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.882186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fb0e7-8c48-4329-a87f-d1a6d0db02c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.882186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fb0e7-8c48-4329-a87f-d1a6d0db02c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.882186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fb0e7-8c48-4329-a87f-d1a6d0db02c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.882186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fb0e7-8c48-4329-a87f-d1a6d0db02c1 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.893540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 826/1624] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:57.895102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d207b6-5382-40ef-a361-8514203946fc None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.895588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d207b6-5382-40ef-a361-8514203946fc None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.895706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-f5661cb2-5644-42ed-8e42-7c1e31c082a6 None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:57.895989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d207b6-5382-40ef-a361-8514203946fc None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.897037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f5661cb2-5644-42ed-8e42-7c1e31c082a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:57.898157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 827/1625] 10.222.0.57 () {54 vars in 961 bytes} [Tue May 10 16:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:44:57.898953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d207b6-5382-40ef-a361-8514203946fc None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.918772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d207b6-5382-40ef-a361-8514203946fc None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.924364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940da2d-249d-4cf7-999e-ce9d6b9742bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.924781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940da2d-249d-4cf7-999e-ce9d6b9742bc admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.925380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940da2d-249d-4cf7-999e-ce9d6b9742bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.925730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940da2d-249d-4cf7-999e-ce9d6b9742bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.926533 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940da2d-249d-4cf7-999e-ce9d6b9742bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.928417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940da2d-249d-4cf7-999e-ce9d6b9742bc admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:57.940487 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 828/1626] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:57.944612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940da2d-249d-4cf7-999e-ce9d6b9742bc admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:57.955012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940da2d-249d-4cf7-999e-ce9d6b9742bc admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:57.960368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53430c6b-1fa1-43a0-94e5-042cf529feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:57.961370 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430c6b-1fa1-43a0-94e5-042cf529feb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.961795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430c6b-1fa1-43a0-94e5-042cf529feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.962140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430c6b-1fa1-43a0-94e5-042cf529feb0 admin admin] PATH_INFO: `/v3/projects/9d9fc5625c5a42fbaf0c80cbfdce7528/users/16befa2b1f094a3fba85f75b52927a80/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.972765 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 799/1627] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:57.976821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3e96-1c38-4ece-8088-d22b24d1cb05 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:57.977050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3e96-1c38-4ece-8088-d22b24d1cb05 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:57.977378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3e96-1c38-4ece-8088-d22b24d1cb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:57.982165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53430c6b-1fa1-43a0-94e5-042cf529feb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9fc5625c5a42fbaf0c80cbfdce7528, user_id=16befa2b1f094a3fba85f75b52927a80, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:57.985655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53430c6b-1fa1-43a0-94e5-042cf529feb0 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:58.000933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-aeee3e96-1c38-4ece-8088-d22b24d1cb05 None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:58.002472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-aeee3e96-1c38-4ece-8088-d22b24d1cb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:58.008563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 829/1628] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:57 2022] PUT /identity/v3/projects/9d9fc5625c5a42fbaf0c80cbfdce7528/users/16befa2b1f094a3fba85f75b52927a80/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:58.009417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53430c6b-1fa1-43a0-94e5-042cf529feb0 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:58.080654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53430c6b-1fa1-43a0-94e5-042cf529feb0 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:58.083104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 800/1629] 10.222.0.57 () {58 vars in 1058 bytes} [Tue May 10 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:58.085437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3e96-1c38-4ece-8088-d22b24d1cb05 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:58.087731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f939ba-1330-4e89-957b-931815710763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:58.088644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f939ba-1330-4e89-957b-931815710763 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.088930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f939ba-1330-4e89-957b-931815710763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.089206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f939ba-1330-4e89-957b-931815710763 admin admin] PATH_INFO: `/v3/projects/b2d63c039a224628b01ba521c31f0ed5/users/c38b30a25a0147a1bc3714714f07a20f/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.105401 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f939ba-1330-4e89-957b-931815710763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d63c039a224628b01ba521c31f0ed5, user_id=c38b30a25a0147a1bc3714714f07a20f, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:58.108832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f939ba-1330-4e89-957b-931815710763 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:58.127838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 830/1630] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:58 2022] PUT /identity/v3/projects/b2d63c039a224628b01ba521c31f0ed5/users/c38b30a25a0147a1bc3714714f07a20f/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:58.127838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f939ba-1330-4e89-957b-931815710763 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:58.160416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3e96-1c38-4ece-8088-d22b24d1cb05 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:58.215023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62467-2302-40ac-8f2d-23824d50b966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:58.215863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62467-2302-40ac-8f2d-23824d50b966 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.216246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62467-2302-40ac-8f2d-23824d50b966 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.216625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62467-2302-40ac-8f2d-23824d50b966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.221625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f939ba-1330-4e89-957b-931815710763 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:58.227217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a23cee-4c40-4c14-827c-d429e2bfd6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:58.228177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a23cee-4c40-4c14-827c-d429e2bfd6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.228464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a23cee-4c40-4c14-827c-d429e2bfd6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.228914 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a23cee-4c40-4c14-827c-d429e2bfd6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.229725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a23cee-4c40-4c14-827c-d429e2bfd6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:58.231938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a23cee-4c40-4c14-827c-d429e2bfd6a3 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:58.244468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 831/1631] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:58.245330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a23cee-4c40-4c14-827c-d429e2bfd6a3 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:58.358137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e62467-2302-40ac-8f2d-23824d50b966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:58.359794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e62467-2302-40ac-8f2d-23824d50b966 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:58.371808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a23cee-4c40-4c14-827c-d429e2bfd6a3 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:58.387875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 801/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:58.388929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62467-2302-40ac-8f2d-23824d50b966 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:58.389325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c75528-7680-42dd-8121-1454af0589b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:58.390001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c75528-7680-42dd-8121-1454af0589b6 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.390461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c75528-7680-42dd-8121-1454af0589b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.390739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c75528-7680-42dd-8121-1454af0589b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.412493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62467-2302-40ac-8f2d-23824d50b966 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:58.419111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c8264-f0c7-4af0-a7e1-1dfdfe547221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:58.419883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c8264-f0c7-4af0-a7e1-1dfdfe547221 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.420240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c8264-f0c7-4af0-a7e1-1dfdfe547221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.420620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c8264-f0c7-4af0-a7e1-1dfdfe547221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.422115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c8264-f0c7-4af0-a7e1-1dfdfe547221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:58.424196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c8264-f0c7-4af0-a7e1-1dfdfe547221 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:58.440653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 802/1633] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:58.441646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c8264-f0c7-4af0-a7e1-1dfdfe547221 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:58.452789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c8264-f0c7-4af0-a7e1-1dfdfe547221 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:58.459370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacaa3a-2e6d-4a25-b8f4-abfd94395ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:58.460378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacaa3a-2e6d-4a25-b8f4-abfd94395ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.460732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacaa3a-2e6d-4a25-b8f4-abfd94395ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.461077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacaa3a-2e6d-4a25-b8f4-abfd94395ebf admin admin] PATH_INFO: `/v3/projects/9d9fc5625c5a42fbaf0c80cbfdce7528/users/16befa2b1f094a3fba85f75b52927a80/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.463322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacaa3a-2e6d-4a25-b8f4-abfd94395ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9fc5625c5a42fbaf0c80cbfdce7528, user_id=16befa2b1f094a3fba85f75b52927a80, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:58.466329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacaa3a-2e6d-4a25-b8f4-abfd94395ebf admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:58.480982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 803/1634] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:58 2022] PUT /identity/v3/projects/9d9fc5625c5a42fbaf0c80cbfdce7528/users/16befa2b1f094a3fba85f75b52927a80/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:58.481989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacaa3a-2e6d-4a25-b8f4-abfd94395ebf admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:58.482102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c75528-7680-42dd-8121-1454af0589b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:58.483977 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c75528-7680-42dd-8121-1454af0589b6 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:58.503560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 832/1635] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:58.505458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f1c7-6934-4f78-9567-1c4044978664 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.505458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f1c7-6934-4f78-9567-1c4044978664 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.505685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f1c7-6934-4f78-9567-1c4044978664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.548463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a3b0f1c7-6934-4f78-9567-1c4044978664 None None] MFA Rules not processed for user `16befa2b1f094a3fba85f75b52927a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:58.550214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a3b0f1c7-6934-4f78-9567-1c4044978664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:58.618295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacaa3a-2e6d-4a25-b8f4-abfd94395ebf admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:58.643905 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32758f8-8b6d-4e22-9f58-f206856be7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:58.645016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32758f8-8b6d-4e22-9f58-f206856be7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.646285 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32758f8-8b6d-4e22-9f58-f206856be7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.646622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32758f8-8b6d-4e22-9f58-f206856be7c2 admin admin] PATH_INFO: `/v3/projects/b2d63c039a224628b01ba521c31f0ed5/users/c38b30a25a0147a1bc3714714f07a20f/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.651585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32758f8-8b6d-4e22-9f58-f206856be7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d63c039a224628b01ba521c31f0ed5, user_id=c38b30a25a0147a1bc3714714f07a20f, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:58.658869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32758f8-8b6d-4e22-9f58-f206856be7c2 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:58.685659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 804/1636] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:44:58 2022] PUT /identity/v3/projects/b2d63c039a224628b01ba521c31f0ed5/users/c38b30a25a0147a1bc3714714f07a20f/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:58.698761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503e92-503d-4f11-b940-1105034c70c4 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.699096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503e92-503d-4f11-b940-1105034c70c4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.699432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503e92-503d-4f11-b940-1105034c70c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.703053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 833/1637] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:58.718647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0f1c7-6934-4f78-9567-1c4044978664 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:58.736084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-95503e92-503d-4f11-b940-1105034c70c4 None None] MFA Rules not processed for user `c38b30a25a0147a1bc3714714f07a20f`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:58.737300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-95503e92-503d-4f11-b940-1105034c70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:58.823329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 805/1638] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:58.901452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0f1c7-6934-4f78-9567-1c4044978664 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:58.912139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b889d-4956-4050-8911-10db3233d4fb None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.912747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b889d-4956-4050-8911-10db3233d4fb None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.913321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b889d-4956-4050-8911-10db3233d4fb None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.915711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 806/1639] 10.222.0.57 () {54 vars in 912 bytes} [Tue May 10 16:44:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:44:58.926063 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b906-b9aa-4e65-ac9d-5fb709ab1682 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.926499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b906-b9aa-4e65-ac9d-5fb709ab1682 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.927652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1b906-b9aa-4e65-ac9d-5fb709ab1682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:58.950777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-bea1b906-b9aa-4e65-ac9d-5fb709ab1682 None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:58.952008 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-bea1b906-b9aa-4e65-ac9d-5fb709ab1682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:58.985607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e507f0-59b7-4f74-8b83-85847090db20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:58.987899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e507f0-59b7-4f74-8b83-85847090db20 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:58.988955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e507f0-59b7-4f74-8b83-85847090db20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:58.989454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e507f0-59b7-4f74-8b83-85847090db20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:59.029476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 807/1640] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:44:59.032715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1b906-b9aa-4e65-ac9d-5fb709ab1682 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:59.049683 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1b906-b9aa-4e65-ac9d-5fb709ab1682 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:59.055484 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd326083-6d48-4bca-9614-565fde7df9c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:59.056183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326083-6d48-4bca-9614-565fde7df9c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:59.056470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326083-6d48-4bca-9614-565fde7df9c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:59.056745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326083-6d48-4bca-9614-565fde7df9c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:59.070075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326083-6d48-4bca-9614-565fde7df9c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:59.073280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326083-6d48-4bca-9614-565fde7df9c1 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:59.074174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e507f0-59b7-4f74-8b83-85847090db20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:59.075971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e507f0-59b7-4f74-8b83-85847090db20 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:59.099385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 834/1641] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:44:59.103893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 808/1642] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:59.221692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e507f0-59b7-4f74-8b83-85847090db20 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:59.233613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e507f0-59b7-4f74-8b83-85847090db20 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:59.248910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95063388-8c07-4dab-a20d-c115f0527bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:59.249765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95063388-8c07-4dab-a20d-c115f0527bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:59.251247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95063388-8c07-4dab-a20d-c115f0527bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:59.253997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95063388-8c07-4dab-a20d-c115f0527bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:59.318120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95063388-8c07-4dab-a20d-c115f0527bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:59.319843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95063388-8c07-4dab-a20d-c115f0527bb3 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:59.348245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 835/1643] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:59.428441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53ab70-1fe3-45a0-a1ab-3f5215843291 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:59.428441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53ab70-1fe3-45a0-a1ab-3f5215843291 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:59.428441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53ab70-1fe3-45a0-a1ab-3f5215843291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:59.491431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6d53ab70-1fe3-45a0-a1ab-3f5215843291 None None] MFA Rules not processed for user `e7e31bed346e408e8499bcc6a3397a82`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:59.493232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6d53ab70-1fe3-45a0-a1ab-3f5215843291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:59.511076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95063388-8c07-4dab-a20d-c115f0527bb3 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:59.525494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95063388-8c07-4dab-a20d-c115f0527bb3 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:59.535182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28df51-2eb3-406f-aeb8-b1371e6ad0a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:59.536827 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28df51-2eb3-406f-aeb8-b1371e6ad0a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:59.537057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28df51-2eb3-406f-aeb8-b1371e6ad0a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:59.537335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28df51-2eb3-406f-aeb8-b1371e6ad0a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:59.677674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 809/1644] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:44:59.692358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28df51-2eb3-406f-aeb8-b1371e6ad0a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:59.694356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9118b-cec5-4828-ba2b-54ad4ce8a3b4 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:59.695389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9118b-cec5-4828-ba2b-54ad4ce8a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:59.696835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9118b-cec5-4828-ba2b-54ad4ce8a3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:59.697684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28df51-2eb3-406f-aeb8-b1371e6ad0a6 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:59.737704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 836/1645] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:44:59.748723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-afd9118b-cec5-4828-ba2b-54ad4ce8a3b4 None None] MFA Rules not processed for user `e7e31bed346e408e8499bcc6a3397a82`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:59.752492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-afd9118b-cec5-4828-ba2b-54ad4ce8a3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:59.772010 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 810/1646] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:59.951404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28df51-2eb3-406f-aeb8-b1371e6ad0a6 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:59.976869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28df51-2eb3-406f-aeb8-b1371e6ad0a6 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:59.995884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95e45-4465-45f7-80af-ff83a1d6911f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:59.996611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95e45-4465-45f7-80af-ff83a1d6911f service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:00.000059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95e45-4465-45f7-80af-ff83a1d6911f service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:00.000492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95e45-4465-45f7-80af-ff83a1d6911f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:00.024600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95e45-4465-45f7-80af-ff83a1d6911f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:00.027674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95e45-4465-45f7-80af-ff83a1d6911f service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:00.043831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9118b-cec5-4828-ba2b-54ad4ce8a3b4 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:00.055240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 837/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:44:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:00.057455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9118b-cec5-4828-ba2b-54ad4ce8a3b4 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:00.067057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a82b2-ce6e-41ee-8c72-452b479664ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:00.067840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a82b2-ce6e-41ee-8c72-452b479664ad service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:00.068175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a82b2-ce6e-41ee-8c72-452b479664ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:00.068502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a82b2-ce6e-41ee-8c72-452b479664ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:00.171713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a82b2-ce6e-41ee-8c72-452b479664ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:00.173279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a82b2-ce6e-41ee-8c72-452b479664ad service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:00.185247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 811/1648] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:00.956307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95e45-4465-45f7-80af-ff83a1d6911f service nova] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:01.015308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f94c9-1d6d-4af3-be20-9269823e7187 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:01.016023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f94c9-1d6d-4af3-be20-9269823e7187 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:01.016523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f94c9-1d6d-4af3-be20-9269823e7187 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:01.019258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 812/1649] 10.222.0.57 () {54 vars in 912 bytes} [Tue May 10 16:45:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:45:01.027803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030490-7f45-4001-8d13-36bfe5ba7553 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:01.028673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030490-7f45-4001-8d13-36bfe5ba7553 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:01.029174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030490-7f45-4001-8d13-36bfe5ba7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:01.089730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95e45-4465-45f7-80af-ff83a1d6911f service nova] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:01.097514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:01.098184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-20030490-7f45-4001-8d13-36bfe5ba7553 None None] MFA Rules not processed for user `05b1227b7f36498e8c1f1e27fa0ccb46`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:01.099396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:01.099553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-20030490-7f45-4001-8d13-36bfe5ba7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:01.100104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:01.100615 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] PATH_INFO: `/v3/users/0a6bd960c8a34c0b87342e82cebac065` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:01.102746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6bd960c8a34c0b87342e82cebac065)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:01.105338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:01.199219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 813/1650] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:45:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:01.221737 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20030490-7f45-4001-8d13-36bfe5ba7553 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:01.228792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6bd960c8a34c0b87342e82cebac065'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:01.230496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20030490-7f45-4001-8d13-36bfe5ba7553 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:01.243431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac840c-8573-4d0b-8c2a-0fe8371ac744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:01.244101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac840c-8573-4d0b-8c2a-0fe8371ac744 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:01.244415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac840c-8573-4d0b-8c2a-0fe8371ac744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:01.244648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac840c-8573-4d0b-8c2a-0fe8371ac744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:01.249668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6bd960c8a34c0b87342e82cebac065'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:01.262563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac840c-8573-4d0b-8c2a-0fe8371ac744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:01.264149 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac840c-8573-4d0b-8c2a-0fe8371ac744 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:01.279236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6bd960c8a34c0b87342e82cebac065'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:01.279236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6bd960c8a34c0b87342e82cebac065'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:01.285562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 814/1651] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:01.294521 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6bd960c8a34c0b87342e82cebac065'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:01.314505 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 838/1652] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:00 2022] DELETE /identity/v3/users/0a6bd960c8a34c0b87342e82cebac065 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:01.316093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210211e8-5b51-4603-970e-a39c8a0f121c None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:01.316711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210211e8-5b51-4603-970e-a39c8a0f121c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:01.317157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210211e8-5b51-4603-970e-a39c8a0f121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:01.352787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-210211e8-5b51-4603-970e-a39c8a0f121c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:01.354809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-210211e8-5b51-4603-970e-a39c8a0f121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:01.446930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 815/1653] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:01.461271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:01.463464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:01.564416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e0077-916a-4696-9f1e-2414fa4a0d61 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:01.575037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea370ad1-3f2d-406b-ad35-c04b5f079077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:01.576350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370ad1-3f2d-406b-ad35-c04b5f079077 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:01.577017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370ad1-3f2d-406b-ad35-c04b5f079077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:01.577306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370ad1-3f2d-406b-ad35-c04b5f079077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:01.597043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea370ad1-3f2d-406b-ad35-c04b5f079077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:01.598899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea370ad1-3f2d-406b-ad35-c04b5f079077 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:01.625369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 839/1654] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:02.105195 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837ce8-2ac4-47e9-8a79-9a2bcd2738f9 None None] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:02.105695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837ce8-2ac4-47e9-8a79-9a2bcd2738f9 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:02.106113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837ce8-2ac4-47e9-8a79-9a2bcd2738f9 None None] PATH_INFO: `/` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:02.110692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 816/1655] 10.222.0.57 () {54 vars in 960 bytes} [Tue May 10 16:45:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:45:02.115970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337234-9bbf-46bd-9dd7-edc197f196f3 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:02.116464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337234-9bbf-46bd-9dd7-edc197f196f3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:02.116739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337234-9bbf-46bd-9dd7-edc197f196f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:02.177368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-47337234-9bbf-46bd-9dd7-edc197f196f3 None None] MFA Rules not processed for user `63ed36df893640fc929d7953751d1116`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:02.178630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-47337234-9bbf-46bd-9dd7-edc197f196f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:02.358918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17837ce8-2ac4-47e9-8a79-9a2bcd2738f9 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:02.363392 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-17837ce8-2ac4-47e9-8a79-9a2bcd2738f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:02.409373 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 840/1656] 10.222.0.57 () {58 vars in 1057 bytes} [Tue May 10 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:02.417955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47337234-9bbf-46bd-9dd7-edc197f196f3 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:02.434040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47337234-9bbf-46bd-9dd7-edc197f196f3 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:02.435287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17837ce8-2ac4-47e9-8a79-9a2bcd2738f9 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:02.450916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:02.451832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:02.452100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:02.452377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] PATH_INFO: `/v3/projects/84172cfab2284ba996a1bac10e937022` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:02.455371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84172cfab2284ba996a1bac10e937022)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:02.456822 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cdef6-6354-488f-8494-0d4d623951d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ed36df893640fc929d7953751d1116', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:02.457478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cdef6-6354-488f-8494-0d4d623951d9 service placement] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:02.459091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:02.460074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cdef6-6354-488f-8494-0d4d623951d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:02.460429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cdef6-6354-488f-8494-0d4d623951d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:02.464672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bb6cdef6-6354-488f-8494-0d4d623951d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:02.486687 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cdef6-6354-488f-8494-0d4d623951d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:02.524513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cdef6-6354-488f-8494-0d4d623951d9 service placement] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:02.527074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 841/1657] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:02.586559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84172cfab2284ba996a1bac10e937022', 'request_id': 'req-eb27b548-6a4d-4871-8465-d21058b6eac4'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:02.616939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84172cfab2284ba996a1bac10e937022', 'request_id': 'req-eb27b548-6a4d-4871-8465-d21058b6eac4'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:02.649663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84172cfab2284ba996a1bac10e937022', 'request_id': 'req-eb27b548-6a4d-4871-8465-d21058b6eac4'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:02.662473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] The token cache is being invalidate because project 84172cfab2284ba996a1bac10e937022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:02.663018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:02.667404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-eb27b548-6a4d-4871-8465-d21058b6eac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:02.676776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aad86-db0f-4ade-a4b3-6b033690b21b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:02.677352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aad86-db0f-4ade-a4b3-6b033690b21b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:02.677863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aad86-db0f-4ade-a4b3-6b033690b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:02.678467 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 817/1658] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:02 2022] DELETE /identity/v3/projects/84172cfab2284ba996a1bac10e937022 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:02.709362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3a9aad86-db0f-4ade-a4b3-6b033690b21b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:02.710622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3a9aad86-db0f-4ade-a4b3-6b033690b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:02.801244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 842/1659] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:02.809155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93dcc9-6e5c-4d42-9957-ef88493b1aed None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:02.809815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93dcc9-6e5c-4d42-9957-ef88493b1aed None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:02.810223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93dcc9-6e5c-4d42-9957-ef88493b1aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:02.833208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-aa93dcc9-6e5c-4d42-9957-ef88493b1aed None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:02.834506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-aa93dcc9-6e5c-4d42-9957-ef88493b1aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:02.846698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 818/1660] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:02.851411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aad86-db0f-4ade-a4b3-6b033690b21b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:02.863232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aad86-db0f-4ade-a4b3-6b033690b21b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:02.868305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:02.868996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:02.869284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:02.869562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:02.870367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:02.870682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:02.872377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:02.908527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93dcc9-6e5c-4d42-9957-ef88493b1aed None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:02.910392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 843/1661] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:02.919991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93dcc9-6e5c-4d42-9957-ef88493b1aed None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:02.925842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196e90c-a9cd-4d9e-8528-867feb46c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:02.926861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196e90c-a9cd-4d9e-8528-867feb46c1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:02.927415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196e90c-a9cd-4d9e-8528-867feb46c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:02.927931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196e90c-a9cd-4d9e-8528-867feb46c1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:02.928829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196e90c-a9cd-4d9e-8528-867feb46c1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:02.931549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196e90c-a9cd-4d9e-8528-867feb46c1f6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:02.973287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 819/1662] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:02 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:02.973754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:02.986946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e727f7b-88f8-43ad-b1de-1753111c346e admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:03.213292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa242-3d76-4fda-a0d7-0fce4841c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:03.214096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa242-3d76-4fda-a0d7-0fce4841c4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:03.214440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa242-3d76-4fda-a0d7-0fce4841c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:03.214788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa242-3d76-4fda-a0d7-0fce4841c4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:03.215647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aa242-3d76-4fda-a0d7-0fce4841c4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:03.217932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aa242-3d76-4fda-a0d7-0fce4841c4f5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:03.257842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196e90c-a9cd-4d9e-8528-867feb46c1f6 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:03.265231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 844/1663] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:02 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:03.270048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196e90c-a9cd-4d9e-8528-867feb46c1f6 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:03.275673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d6b2-d460-4dc8-a8a0-2262c5d6d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:03.276498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d6b2-d460-4dc8-a8a0-2262c5d6d2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:03.276877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d6b2-d460-4dc8-a8a0-2262c5d6d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:03.277166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d6b2-d460-4dc8-a8a0-2262c5d6d2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:03.277960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485d6b2-d460-4dc8-a8a0-2262c5d6d2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:03.279686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485d6b2-d460-4dc8-a8a0-2262c5d6d2d5 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:03.294040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 820/1664] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:03.298175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa242-3d76-4fda-a0d7-0fce4841c4f5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:03.310623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa242-3d76-4fda-a0d7-0fce4841c4f5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:03.317648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a654c5c-bd21-4e44-ab43-d1e1f42abb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:03.318390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654c5c-bd21-4e44-ab43-d1e1f42abb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:03.318681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654c5c-bd21-4e44-ab43-d1e1f42abb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:03.319120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a654c5c-bd21-4e44-ab43-d1e1f42abb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:03.320253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a654c5c-bd21-4e44-ab43-d1e1f42abb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:03.322540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a654c5c-bd21-4e44-ab43-d1e1f42abb75 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:03.343280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 845/1665] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:03.346487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d6b2-d460-4dc8-a8a0-2262c5d6d2d5 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:03.365009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d6b2-d460-4dc8-a8a0-2262c5d6d2d5 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:03.371852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892014-29b8-4bf6-b14f-36f545170b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:03.373155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892014-29b8-4bf6-b14f-36f545170b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:03.373610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892014-29b8-4bf6-b14f-36f545170b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:03.374051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9892014-29b8-4bf6-b14f-36f545170b49 admin admin] PATH_INFO: `/v3/projects/25f75ba43acc4b2b865f384ffb219f0c/users/5b105519eaff4ebca8c39fca5227a667/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:03.395340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9892014-29b8-4bf6-b14f-36f545170b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f75ba43acc4b2b865f384ffb219f0c, user_id=5b105519eaff4ebca8c39fca5227a667, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:03.398717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9892014-29b8-4bf6-b14f-36f545170b49 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:03.421061 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 821/1666] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:03 2022] PUT /identity/v3/projects/25f75ba43acc4b2b865f384ffb219f0c/users/5b105519eaff4ebca8c39fca5227a667/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:03.432875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a24a7-6fcb-4f41-bb69-997154ea1794 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:03.433167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a24a7-6fcb-4f41-bb69-997154ea1794 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:03.433449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a24a7-6fcb-4f41-bb69-997154ea1794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:03.491216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-031a24a7-6fcb-4f41-bb69-997154ea1794 None None] MFA Rules not processed for user `5b105519eaff4ebca8c39fca5227a667`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:03.492900 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-031a24a7-6fcb-4f41-bb69-997154ea1794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:03.751765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 846/1667] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:03.752999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892014-29b8-4bf6-b14f-36f545170b49 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:03.956147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9892014-29b8-4bf6-b14f-36f545170b49 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:03.966268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e8d87-5940-48ba-88b3-94cec14666fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:03.967244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8d87-5940-48ba-88b3-94cec14666fa admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:03.967665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8d87-5940-48ba-88b3-94cec14666fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:03.968241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e8d87-5940-48ba-88b3-94cec14666fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:03.969763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e8d87-5940-48ba-88b3-94cec14666fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:03.971905 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e8d87-5940-48ba-88b3-94cec14666fa admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:04.036128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 822/1668] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:03 2022] POST /identity/v3/projects => generated 369 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:04.040217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a24a7-6fcb-4f41-bb69-997154ea1794 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:04.062089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a24a7-6fcb-4f41-bb69-997154ea1794 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:04.239798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2a439-a098-4157-8de8-b26b4214ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:04.240508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2a439-a098-4157-8de8-b26b4214ea29 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:04.240792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2a439-a098-4157-8de8-b26b4214ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:04.241065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2a439-a098-4157-8de8-b26b4214ea29 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:04.241775 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2a439-a098-4157-8de8-b26b4214ea29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:04.243744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2a439-a098-4157-8de8-b26b4214ea29 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:04.322281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 847/1669] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:04 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:04.328696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e8d87-5940-48ba-88b3-94cec14666fa admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:04.356803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e8d87-5940-48ba-88b3-94cec14666fa admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:04.374506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3e07-5dc7-4453-bd89-5d20bed0d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:04.375361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3e07-5dc7-4453-bd89-5d20bed0d45a admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:04.379479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3e07-5dc7-4453-bd89-5d20bed0d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:04.381932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3e07-5dc7-4453-bd89-5d20bed0d45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:04.384021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d3e07-5dc7-4453-bd89-5d20bed0d45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:04.389030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d3e07-5dc7-4453-bd89-5d20bed0d45a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:04.431169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 823/1670] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:04.435741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2a439-a098-4157-8de8-b26b4214ea29 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:04.457321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2a439-a098-4157-8de8-b26b4214ea29 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:04.473486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339a8e8-982d-461a-b8b8-62cd9cea55af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:04.474435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339a8e8-982d-461a-b8b8-62cd9cea55af admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:04.474732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339a8e8-982d-461a-b8b8-62cd9cea55af admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:04.475028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339a8e8-982d-461a-b8b8-62cd9cea55af admin admin] PATH_INFO: `/v3/projects/e9a7411997d54fc39f7e42d1d0350013/users/d551d1d422a34aac9c1068b4ee568dab/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:04.537877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339a8e8-982d-461a-b8b8-62cd9cea55af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a7411997d54fc39f7e42d1d0350013, user_id=d551d1d422a34aac9c1068b4ee568dab, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:04.547033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339a8e8-982d-461a-b8b8-62cd9cea55af admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:04.577078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 848/1671] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:04 2022] PUT /identity/v3/projects/e9a7411997d54fc39f7e42d1d0350013/users/d551d1d422a34aac9c1068b4ee568dab/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:04.581396 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3e07-5dc7-4453-bd89-5d20bed0d45a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:04.596234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3e07-5dc7-4453-bd89-5d20bed0d45a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:04.824598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93efb-43b1-43a1-8c62-c9801d9ba29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:04.825559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93efb-43b1-43a1-8c62-c9801d9ba29b admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:04.825981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93efb-43b1-43a1-8c62-c9801d9ba29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:04.826394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93efb-43b1-43a1-8c62-c9801d9ba29b admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:04.827457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93efb-43b1-43a1-8c62-c9801d9ba29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:04.829809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93efb-43b1-43a1-8c62-c9801d9ba29b admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:04.855675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 824/1672] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:04.857065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339a8e8-982d-461a-b8b8-62cd9cea55af admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:04.867515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339a8e8-982d-461a-b8b8-62cd9cea55af admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:04.902998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:04.904128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:04.904417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:04.904820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] PATH_INFO: `/v3/projects/e9a7411997d54fc39f7e42d1d0350013/users/d551d1d422a34aac9c1068b4ee568dab/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:04.915998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a7411997d54fc39f7e42d1d0350013, user_id=d551d1d422a34aac9c1068b4ee568dab, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:04.942612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:04.955273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 849/1673] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:04 2022] PUT /identity/v3/projects/e9a7411997d54fc39f7e42d1d0350013/users/d551d1d422a34aac9c1068b4ee568dab/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:04.965913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7552-ba67-4162-9e65-baac3c8f5ae4 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:04.966489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7552-ba67-4162-9e65-baac3c8f5ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:04.966936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7552-ba67-4162-9e65-baac3c8f5ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:05.071127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-84ba7552-ba67-4162-9e65-baac3c8f5ae4 None None] MFA Rules not processed for user `d551d1d422a34aac9c1068b4ee568dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:05.072485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-84ba7552-ba67-4162-9e65-baac3c8f5ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:05.259320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 825/1674] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:05.407479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:05.410505 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:05.600060 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3265a-b814-482f-9e6f-86a56005bf30 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:05.604288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:05.605215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:05.605862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:05.607114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:05.618424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:05.620363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:05.633248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 850/1675] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:07.683025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060261dc-6635-41a0-840b-9efa914c6280 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:07.685320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060261dc-6635-41a0-840b-9efa914c6280 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:07.685765 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060261dc-6635-41a0-840b-9efa914c6280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:07.756622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-060261dc-6635-41a0-840b-9efa914c6280 None None] MFA Rules not processed for user `48a7478e69d740e89da1201c954cbfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:07.757893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-060261dc-6635-41a0-840b-9efa914c6280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:07.919579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 826/1676] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:07.928233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:07.930330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:08.048186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1dc2e-f164-4182-a418-79174c859b46 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:08.065993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:08.066872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:08.067390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:08.067803 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:08.083971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:08.085970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:08.115333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 851/1677] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:08.215071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfa71-c531-4d50-ae13-cc7e0bde73c2 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:08.215378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfa71-c531-4d50-ae13-cc7e0bde73c2 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:08.215645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfa71-c531-4d50-ae13-cc7e0bde73c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:08.262115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-b40dfa71-c531-4d50-ae13-cc7e0bde73c2 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:08.263665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b40dfa71-c531-4d50-ae13-cc7e0bde73c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:08.398035 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 827/1678] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:08.664624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:08.666944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:08.795402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f01ee-ba3f-41df-9f4f-83e4d07ed557 service nova] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:08.804132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fac2ff-3bc9-42e0-806f-6285f1782a2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:08.805119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac2ff-3bc9-42e0-806f-6285f1782a2e service swift] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:08.805479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac2ff-3bc9-42e0-806f-6285f1782a2e service swift] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:08.815305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac2ff-3bc9-42e0-806f-6285f1782a2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:08.841983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fac2ff-3bc9-42e0-806f-6285f1782a2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:08.849322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fac2ff-3bc9-42e0-806f-6285f1782a2e service swift] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:08.880509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 852/1679] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:45:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:45:08.924110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888552-7a08-4bbc-ac18-6e0f5600e9ee None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:08.924631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888552-7a08-4bbc-ac18-6e0f5600e9ee None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:08.924705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888552-7a08-4bbc-ac18-6e0f5600e9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:08.957173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-be888552-7a08-4bbc-ac18-6e0f5600e9ee None None] MFA Rules not processed for user `de5e76d5385f44fab03527751a478f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:08.958625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-be888552-7a08-4bbc-ac18-6e0f5600e9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:09.211036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 828/1680] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:09.217683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853e23-76f5-4b48-a707-027010e80f93 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:09.218161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853e23-76f5-4b48-a707-027010e80f93 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:09.218258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853e23-76f5-4b48-a707-027010e80f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:09.290812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c0853e23-76f5-4b48-a707-027010e80f93 None None] MFA Rules not processed for user `de5e76d5385f44fab03527751a478f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:09.292078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c0853e23-76f5-4b48-a707-027010e80f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:09.329704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 853/1681] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:09.339351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888552-7a08-4bbc-ac18-6e0f5600e9ee None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:09.340652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-be888552-7a08-4bbc-ac18-6e0f5600e9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:09.372337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888552-7a08-4bbc-ac18-6e0f5600e9ee None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:09.407924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c8e2-cc81-435d-9ddd-b7b90a930c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:09.408718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c8e2-cc81-435d-9ddd-b7b90a930c80 service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:09.415295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c8e2-cc81-435d-9ddd-b7b90a930c80 service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:09.415725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c8e2-cc81-435d-9ddd-b7b90a930c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:09.443238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c8e2-cc81-435d-9ddd-b7b90a930c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:09.446294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c8e2-cc81-435d-9ddd-b7b90a930c80 service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:09.475865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 829/1682] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:09.561032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853e23-76f5-4b48-a707-027010e80f93 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:09.827985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853e23-76f5-4b48-a707-027010e80f93 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:09.851971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:09.853515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:09.853963 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:09.854374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] PATH_INFO: `/v3/users/5b105519eaff4ebca8c39fca5227a667` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:09.856409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b105519eaff4ebca8c39fca5227a667)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:09.864302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:09.956355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b105519eaff4ebca8c39fca5227a667'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:09.986330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b105519eaff4ebca8c39fca5227a667'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:10.001169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b105519eaff4ebca8c39fca5227a667'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:10.002303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b105519eaff4ebca8c39fca5227a667'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:10.036181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b105519eaff4ebca8c39fca5227a667'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:10.057690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 854/1683] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:09 2022] DELETE /identity/v3/users/5b105519eaff4ebca8c39fca5227a667 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:10.063273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2ad6-5d1c-4b3a-b39d-7fe588eb87a4 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:10.063847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2ad6-5d1c-4b3a-b39d-7fe588eb87a4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:10.063847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2ad6-5d1c-4b3a-b39d-7fe588eb87a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:10.112166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ff0b2ad6-5d1c-4b3a-b39d-7fe588eb87a4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:10.113384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ff0b2ad6-5d1c-4b3a-b39d-7fe588eb87a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:10.325870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 830/1684] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:10.370001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:10.372329 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:10.620464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a861-dd3f-4f57-b4b2-8b3f661a399b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:10.632279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:10.641133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:10.643547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:10.644397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:10.667970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:10.670901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:10.705204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 855/1685] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:12.275975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c57a9-d75a-488a-9b1a-02aa98e300dc None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:12.277192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c57a9-d75a-488a-9b1a-02aa98e300dc None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:12.277611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c57a9-d75a-488a-9b1a-02aa98e300dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:12.280805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:12.284134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:12.321924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9409504-115f-495a-9bd8-fd1e26eb493f service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:12.337224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5d5c57a9-d75a-488a-9b1a-02aa98e300dc None None] MFA Rules not processed for user `05b1227b7f36498e8c1f1e27fa0ccb46`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:12.339241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5d5c57a9-d75a-488a-9b1a-02aa98e300dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:12.341446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:12.345561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:12.346134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:12.348048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] PATH_INFO: `/v3/projects/25f75ba43acc4b2b865f384ffb219f0c` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:12.351533 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f75ba43acc4b2b865f384ffb219f0c)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:12.354869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: WARNING py.warnings [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:45:12.354869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: warnings.warn(msg) May 10 16:45:12.354869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: May 10 16:45:12.358907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:12.368381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 831/1686] 10.222.0.59 () {58 vars in 1015 bytes} [Tue May 10 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:12.387526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c57a9-d75a-488a-9b1a-02aa98e300dc None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:12.396769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c57a9-d75a-488a-9b1a-02aa98e300dc None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:12.428402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691680a8-dd3e-40bd-b9fc-50d4011fab41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:12.429068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691680a8-dd3e-40bd-b9fc-50d4011fab41 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:12.429349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691680a8-dd3e-40bd-b9fc-50d4011fab41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:12.429620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691680a8-dd3e-40bd-b9fc-50d4011fab41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:12.456420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691680a8-dd3e-40bd-b9fc-50d4011fab41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:12.463689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691680a8-dd3e-40bd-b9fc-50d4011fab41 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:12.523828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 832/1687] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:12.558082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f75ba43acc4b2b865f384ffb219f0c', 'request_id': 'req-09716532-ae7d-44a8-abe9-32d7db7908d5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:12.583955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f75ba43acc4b2b865f384ffb219f0c', 'request_id': 'req-09716532-ae7d-44a8-abe9-32d7db7908d5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:12.595655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f75ba43acc4b2b865f384ffb219f0c', 'request_id': 'req-09716532-ae7d-44a8-abe9-32d7db7908d5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:12.634211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] The token cache is being invalidate because project 25f75ba43acc4b2b865f384ffb219f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:12.634817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:12.635829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-09716532-ae7d-44a8-abe9-32d7db7908d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:12.640245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 856/1688] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:12 2022] DELETE /identity/v3/projects/25f75ba43acc4b2b865f384ffb219f0c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:12.644834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691680a8-dd3e-40bd-b9fc-50d4011fab41 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:12.669407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691680a8-dd3e-40bd-b9fc-50d4011fab41 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:12.885558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:12.889465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:12.890560 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:12.891674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] PATH_INFO: `/v3/users/d551d1d422a34aac9c1068b4ee568dab` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:12.903299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d551d1d422a34aac9c1068b4ee568dab)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:12.908895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: WARNING py.warnings [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:45:12.908895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: warnings.warn(msg) May 10 16:45:12.908895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: May 10 16:45:12.921564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:13.139730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd551d1d422a34aac9c1068b4ee568dab'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:13.176091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd551d1d422a34aac9c1068b4ee568dab'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:13.205523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd551d1d422a34aac9c1068b4ee568dab'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:13.207391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd551d1d422a34aac9c1068b4ee568dab'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:13.300244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd551d1d422a34aac9c1068b4ee568dab'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:13.341169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 833/1689] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:12 2022] DELETE /identity/v3/users/d551d1d422a34aac9c1068b4ee568dab => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:13.659705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86579-81a1-416b-bfc3-8fdadbc90496 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:13.660333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86579-81a1-416b-bfc3-8fdadbc90496 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:13.660333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86579-81a1-416b-bfc3-8fdadbc90496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:13.711448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-96c86579-81a1-416b-bfc3-8fdadbc90496 None None] MFA Rules not processed for user `de5e76d5385f44fab03527751a478f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:13.721268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-96c86579-81a1-416b-bfc3-8fdadbc90496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:13.956333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 857/1690] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:14.289050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:14.291005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:14.528476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f555a-984c-49f8-9e9e-911ace8f178a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:14.543608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:14.547813 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:14.550927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:14.554215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] PATH_INFO: `/v3/users/12295672982a4855b09a742cc5a2d860` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:14.557121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12295672982a4855b09a742cc5a2d860)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:14.562302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:14.729743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12295672982a4855b09a742cc5a2d860'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:14.751536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12295672982a4855b09a742cc5a2d860'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:14.775596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12295672982a4855b09a742cc5a2d860'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:14.777284 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12295672982a4855b09a742cc5a2d860'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:14.801862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffab05-2ef3-461c-ae5b-a7589565cb73 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:14.802353 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffab05-2ef3-461c-ae5b-a7589565cb73 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:14.802679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffab05-2ef3-461c-ae5b-a7589565cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:14.820379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-daafb6a9-e360-4cfb-9dc4-afc7292fa5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12295672982a4855b09a742cc5a2d860'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:14.829395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 834/1691] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:14 2022] DELETE /identity/v3/users/12295672982a4855b09a742cc5a2d860 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:14.838475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58a965-7f42-4c4d-91b2-5d9859ff2ae6 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:14.839835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58a965-7f42-4c4d-91b2-5d9859ff2ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:14.841018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58a965-7f42-4c4d-91b2-5d9859ff2ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:14.892375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8fffab05-2ef3-461c-ae5b-a7589565cb73 None None] MFA Rules not processed for user `48a7478e69d740e89da1201c954cbfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:14.904937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8fffab05-2ef3-461c-ae5b-a7589565cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:14.906155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-bf58a965-7f42-4c4d-91b2-5d9859ff2ae6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:14.910381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-bf58a965-7f42-4c4d-91b2-5d9859ff2ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:15.120918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 835/1692] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:15.145987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 858/1693] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:15.199472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58a965-7f42-4c4d-91b2-5d9859ff2ae6 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:15.201216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-bf58a965-7f42-4c4d-91b2-5d9859ff2ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:15.368251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58a965-7f42-4c4d-91b2-5d9859ff2ae6 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:15.372477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127dee3-0a9d-4d33-b8aa-18d15c982898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:15.373438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127dee3-0a9d-4d33-b8aa-18d15c982898 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:15.373948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127dee3-0a9d-4d33-b8aa-18d15c982898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:15.374738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127dee3-0a9d-4d33-b8aa-18d15c982898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:15.401728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e89fa-6522-4547-ac00-1bd0ce4558ef None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:15.402423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e89fa-6522-4547-ac00-1bd0ce4558ef None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:15.403724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e89fa-6522-4547-ac00-1bd0ce4558ef None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:15.405693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 859/1694] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:45:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:45:15.410749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127dee3-0a9d-4d33-b8aa-18d15c982898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:15.414050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127dee3-0a9d-4d33-b8aa-18d15c982898 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:15.452364 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 836/1695] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:15.472927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e89fa-6522-4547-ac00-1bd0ce4558ef None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:15.474906 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2c4e89fa-6522-4547-ac00-1bd0ce4558ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:15.482654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb645e-9e59-41b9-8589-8128871f4acf None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:15.483192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb645e-9e59-41b9-8589-8128871f4acf None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:15.484021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb645e-9e59-41b9-8589-8128871f4acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:15.525032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e89fa-6522-4547-ac00-1bd0ce4558ef None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:15.530754 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d1bb645e-9e59-41b9-8589-8128871f4acf None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:15.534077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d1bb645e-9e59-41b9-8589-8128871f4acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:15.539153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:15.540157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:15.545020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:15.546344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] PATH_INFO: `/v3/users/fde21cc42af64e03b9390ff82511035d` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:15.551424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde21cc42af64e03b9390ff82511035d)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:15.565424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:15.822551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde21cc42af64e03b9390ff82511035d'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:15.854282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde21cc42af64e03b9390ff82511035d'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:15.870913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde21cc42af64e03b9390ff82511035d'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:15.871637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde21cc42af64e03b9390ff82511035d'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:15.904023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde21cc42af64e03b9390ff82511035d'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:15.911757 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 837/1696] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:15.927852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 860/1697] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:15 2022] DELETE /identity/v3/users/fde21cc42af64e03b9390ff82511035d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:15.932943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c672f4-1d74-40d9-bbcd-e7084927ec48 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:15.933384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c672f4-1d74-40d9-bbcd-e7084927ec48 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:15.933800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c672f4-1d74-40d9-bbcd-e7084927ec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:15.984667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-b1c672f4-1d74-40d9-bbcd-e7084927ec48 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:15.985922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b1c672f4-1d74-40d9-bbcd-e7084927ec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:16.222635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 838/1698] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:16.234483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:16.237002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:16.388033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bab91a-4aba-426f-9cc4-e633e938faa8 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:16.392508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:16.393707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:16.393707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:16.393707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:16.429746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:16.431459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:16.475819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 861/1699] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:16.542030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c672f4-1d74-40d9-bbcd-e7084927ec48 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:16.543459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b1c672f4-1d74-40d9-bbcd-e7084927ec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:16.563952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c672f4-1d74-40d9-bbcd-e7084927ec48 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:16.588757 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:16.589952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:16.590540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:16.591034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] PATH_INFO: `/v3/projects/e9a7411997d54fc39f7e42d1d0350013` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:16.595012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a7411997d54fc39f7e42d1d0350013)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:16.600442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:16.714819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:16.717795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:16.762827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a7411997d54fc39f7e42d1d0350013', 'request_id': 'req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:16.767494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc06b5-5103-4dd6-a24f-95d9136e638c service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:16.811007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a7411997d54fc39f7e42d1d0350013', 'request_id': 'req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:16.839916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a7411997d54fc39f7e42d1d0350013', 'request_id': 'req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:16.886528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] The token cache is being invalidate because project e9a7411997d54fc39f7e42d1d0350013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:16.890596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:16.894225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8f26e3c5-9c24-46cb-a7b8-274e5b6364d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:16.904477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 839/1700] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:16 2022] DELETE /identity/v3/projects/e9a7411997d54fc39f7e42d1d0350013 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:16.910336 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c0c4-2a0a-4434-b037-1f58d664d3e7 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:16.910742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c0c4-2a0a-4434-b037-1f58d664d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:16.912304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121c0c4-2a0a-4434-b037-1f58d664d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:16.961441 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:16.964694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:16.964988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:16.967543 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] PATH_INFO: `/v3/projects/f97b3ffb197e43f3b3d839655c932d07` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:16.973178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97b3ffb197e43f3b3d839655c932d07)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:16.981059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:17.018819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e121c0c4-2a0a-4434-b037-1f58d664d3e7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:17.020930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e121c0c4-2a0a-4434-b037-1f58d664d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:17.077458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 840/1701] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:17.088540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e243f-e183-4feb-bc84-87876e8212ab None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.089881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e243f-e183-4feb-bc84-87876e8212ab None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.090624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e243f-e183-4feb-bc84-87876e8212ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.207082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-4c2e243f-e183-4feb-bc84-87876e8212ab None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:17.211769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97b3ffb197e43f3b3d839655c932d07', 'request_id': 'req-786e1e65-c19e-4777-8814-46ba04f925eb'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:17.216340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4c2e243f-e183-4feb-bc84-87876e8212ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:17.236416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97b3ffb197e43f3b3d839655c932d07', 'request_id': 'req-786e1e65-c19e-4777-8814-46ba04f925eb'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:17.252536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97b3ffb197e43f3b3d839655c932d07', 'request_id': 'req-786e1e65-c19e-4777-8814-46ba04f925eb'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:17.296348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] The token cache is being invalidate because project f97b3ffb197e43f3b3d839655c932d07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:17.297432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:17.299697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-786e1e65-c19e-4777-8814-46ba04f925eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:17.306302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 862/1702] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:16 2022] DELETE /identity/v3/projects/f97b3ffb197e43f3b3d839655c932d07 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:17.312501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6b88-abbf-4857-b32d-154539fd9aed None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.312793 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6b88-abbf-4857-b32d-154539fd9aed None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.313079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6b88-abbf-4857-b32d-154539fd9aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.337221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c74e6b88-abbf-4857-b32d-154539fd9aed None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:17.338260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c74e6b88-abbf-4857-b32d-154539fd9aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:17.410898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 863/1703] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:17.420523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e5ae3-1703-4f1e-9ac0-56a938be1c88 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.422163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e5ae3-1703-4f1e-9ac0-56a938be1c88 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.422453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e5ae3-1703-4f1e-9ac0-56a938be1c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.450764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 841/1704] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:17.452642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e243f-e183-4feb-bc84-87876e8212ab None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:17.469430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e243f-e183-4feb-bc84-87876e8212ab None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:17.477679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:17.478307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.478595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.478875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.479653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:17.480269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:17.481935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:17.493936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8e7e5ae3-1703-4f1e-9ac0-56a938be1c88 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:17.497853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8e7e5ae3-1703-4f1e-9ac0-56a938be1c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:17.508940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 842/1705] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:17.516511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:17.532972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507efa6-fb9f-4c3b-9714-bc4e888a4e4d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:17.539552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 864/1706] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:17.543282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2c5d1-d17b-4331-bf9c-3b0302aea99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:17.544075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c5d1-d17b-4331-bf9c-3b0302aea99d admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.544366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c5d1-d17b-4331-bf9c-3b0302aea99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.544465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e5ae3-1703-4f1e-9ac0-56a938be1c88 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:17.544650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c5d1-d17b-4331-bf9c-3b0302aea99d admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.545517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2c5d1-d17b-4331-bf9c-3b0302aea99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:17.547770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2c5d1-d17b-4331-bf9c-3b0302aea99d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:17.602354 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e5ae3-1703-4f1e-9ac0-56a938be1c88 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:17.613609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 843/1707] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:17 2022] POST /identity/v3/projects => generated 359 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:17.614876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2c5d1-d17b-4331-bf9c-3b0302aea99d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:17.629379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c083637-2d17-4b9a-a221-d24fea15ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:17.630065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c083637-2d17-4b9a-a221-d24fea15ecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.630347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c083637-2d17-4b9a-a221-d24fea15ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.630624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c083637-2d17-4b9a-a221-d24fea15ecd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.644437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c083637-2d17-4b9a-a221-d24fea15ecd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:17.647190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c083637-2d17-4b9a-a221-d24fea15ecd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:17.659028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c083637-2d17-4b9a-a221-d24fea15ecd2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:17.693345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2c5d1-d17b-4331-bf9c-3b0302aea99d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:17.705226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5ef15-e33c-4826-8f3c-e823c3588159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:17.707489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5ef15-e33c-4826-8f3c-e823c3588159 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.707899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5ef15-e33c-4826-8f3c-e823c3588159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.715307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5ef15-e33c-4826-8f3c-e823c3588159 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.715919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 865/1708] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:17.716018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5ef15-e33c-4826-8f3c-e823c3588159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:17.716801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafe25-45e5-40b2-ae3d-0961f6a96c17 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.717382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafe25-45e5-40b2-ae3d-0961f6a96c17 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.718705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafe25-45e5-40b2-ae3d-0961f6a96c17 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.719788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5ef15-e33c-4826-8f3c-e823c3588159 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:17.721328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 866/1709] 10.222.0.57 () {54 vars in 912 bytes} [Tue May 10 16:45:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:45:17.722074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cafe25-45e5-40b2-ae3d-0961f6a96c17 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:17.758174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cafe25-45e5-40b2-ae3d-0961f6a96c17 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:17.770571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 844/1710] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:17 2022] POST /identity/v3/users => generated 280 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:17.771446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8263d-5f2b-4485-a3f9-8d6a03eec611 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.771617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8263d-5f2b-4485-a3f9-8d6a03eec611 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.771901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8263d-5f2b-4485-a3f9-8d6a03eec611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.773641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500e06e-5ad9-499c-bd23-78a95327e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:17.774550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500e06e-5ad9-499c-bd23-78a95327e7ef admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:17.774659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500e06e-5ad9-499c-bd23-78a95327e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:17.774913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500e06e-5ad9-499c-bd23-78a95327e7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:17.775637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500e06e-5ad9-499c-bd23-78a95327e7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:17.782307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500e06e-5ad9-499c-bd23-78a95327e7ef admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:17.829494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d2a8263d-5f2b-4485-a3f9-8d6a03eec611 None None] MFA Rules not processed for user `05b1227b7f36498e8c1f1e27fa0ccb46`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:17.833391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d2a8263d-5f2b-4485-a3f9-8d6a03eec611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:17.854783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 867/1711] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:17 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:17.858357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500e06e-5ad9-499c-bd23-78a95327e7ef admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.034991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 845/1712] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:45:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:18.035926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8263d-5f2b-4485-a3f9-8d6a03eec611 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.039135 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500e06e-5ad9-499c-bd23-78a95327e7ef admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.044667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.045379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.045682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.045972 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.048195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.050491 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.064215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 868/1713] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:18.065128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.066848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:18.082812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8263d-5f2b-4485-a3f9-8d6a03eec611 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.102445 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70116b8-58c4-47c9-8031-b88dc0289108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.103474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70116b8-58c4-47c9-8031-b88dc0289108 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.104202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70116b8-58c4-47c9-8031-b88dc0289108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.104623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70116b8-58c4-47c9-8031-b88dc0289108 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.107219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70116b8-58c4-47c9-8031-b88dc0289108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.112434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70116b8-58c4-47c9-8031-b88dc0289108 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.195877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 846/1714] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:18 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:18.196820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70116b8-58c4-47c9-8031-b88dc0289108 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.213891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0201df-ece2-4e5e-8d4c-672e244ba12b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.235615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70116b8-58c4-47c9-8031-b88dc0289108 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.241743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.242485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.242874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.243271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.252516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:18.261588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.262585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.262731 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.263085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.263800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.265552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.303341 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 847/1715] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:18.304152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.304267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.305909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.313190 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:18.349400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 869/1716] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:18.369103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.415924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbba45-5c1a-4074-a5c5-3aa401c03046 service nova] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.433489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b69a9-d328-44bf-bbce-ae188a6d9354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.434279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b69a9-d328-44bf-bbce-ae188a6d9354 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.434568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b69a9-d328-44bf-bbce-ae188a6d9354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.434847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b69a9-d328-44bf-bbce-ae188a6d9354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.435626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b69a9-d328-44bf-bbce-ae188a6d9354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.443967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b69a9-d328-44bf-bbce-ae188a6d9354 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.478092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 870/1717] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:18.487885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b69a9-d328-44bf-bbce-ae188a6d9354 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.519399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b69a9-d328-44bf-bbce-ae188a6d9354 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.544875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.545819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.546142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.546421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] PATH_INFO: `/v3/projects/fb5dac2161dd464bb340646dd9386fdb/users/b38840931f7443a89b8dfa160d8088bf/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.610112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d6dd-0740-47e2-a2e2-91fed1ecca8f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.624803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20165-7035-454c-a6a6-9b0366d317d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.626456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20165-7035-454c-a6a6-9b0366d317d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.626895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20165-7035-454c-a6a6-9b0366d317d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.627824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20165-7035-454c-a6a6-9b0366d317d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.627946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5dac2161dd464bb340646dd9386fdb, user_id=b38840931f7443a89b8dfa160d8088bf, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.630813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.651308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20165-7035-454c-a6a6-9b0366d317d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.656032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20165-7035-454c-a6a6-9b0366d317d1 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.680279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 871/1718] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:18 2022] PUT /identity/v3/projects/fb5dac2161dd464bb340646dd9386fdb/users/b38840931f7443a89b8dfa160d8088bf/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:18.689479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 848/1719] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:18.690348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.693181 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20165-7035-454c-a6a6-9b0366d317d1 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.703273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:18.728133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20165-7035-454c-a6a6-9b0366d317d1 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.849121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145837-a1c9-4bbb-9a97-329714a43944 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.866231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.869758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.871031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.871516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] PATH_INFO: `/v3/users/ab008506d8944c94b018d239abfcbc4f` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.874811 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab008506d8944c94b018d239abfcbc4f)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.881278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.892001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.895299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.895663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.897037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.899689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.906059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:18.929143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 849/1720] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:18.933411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:18.939900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:18.970434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc28791-3eb4-4660-88b7-2472d3202ef9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:18.987981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:18.989204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:18.989633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:18.990086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] PATH_INFO: `/v3/projects/6d32f3859d964423a98c13e212e34a5b` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:18.991665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab008506d8944c94b018d239abfcbc4f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:18.992498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d32f3859d964423a98c13e212e34a5b)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:18.994898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:19.005838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab008506d8944c94b018d239abfcbc4f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.021347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab008506d8944c94b018d239abfcbc4f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.022198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab008506d8944c94b018d239abfcbc4f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.050851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9ec1ba42-4562-4f42-98f5-b9cac6250c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab008506d8944c94b018d239abfcbc4f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.066275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 872/1721] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:18 2022] DELETE /identity/v3/users/ab008506d8944c94b018d239abfcbc4f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:19.072340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd477d-2f27-425a-93f7-a7c741cf20c7 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:19.072657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd477d-2f27-425a-93f7-a7c741cf20c7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:19.072944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd477d-2f27-425a-93f7-a7c741cf20c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:19.108353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d32f3859d964423a98c13e212e34a5b', 'request_id': 'req-a61ccf59-3e32-41a1-9520-a50f1899587e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.122177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d32f3859d964423a98c13e212e34a5b', 'request_id': 'req-a61ccf59-3e32-41a1-9520-a50f1899587e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.135047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d32f3859d964423a98c13e212e34a5b', 'request_id': 'req-a61ccf59-3e32-41a1-9520-a50f1899587e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.150497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e2cd477d-2f27-425a-93f7-a7c741cf20c7 None None] MFA Rules not processed for user `b38840931f7443a89b8dfa160d8088bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:19.155269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e2cd477d-2f27-425a-93f7-a7c741cf20c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:19.158987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] The token cache is being invalidate because project 6d32f3859d964423a98c13e212e34a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:19.161036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.162357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:19.164712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 850/1722] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:18 2022] DELETE /identity/v3/projects/6d32f3859d964423a98c13e212e34a5b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:19.167261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:19.171005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:19.334951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 873/1723] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:19.354892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c74e0a-c5df-4fc1-8d6a-254dc22e18ff None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:19.358447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c74e0a-c5df-4fc1-8d6a-254dc22e18ff None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:19.358727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c74e0a-c5df-4fc1-8d6a-254dc22e18ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:19.372193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ccf59-3e32-41a1-9520-a50f1899587e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:19.396098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:19.397122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:19.398068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:19.398068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] PATH_INFO: `/v3/projects/76adee13619c4c18a600704ce4487a8f/users/6b160a08080b4ec2bdfc8bf74b18351e/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:19.422799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-19c74e0a-c5df-4fc1-8d6a-254dc22e18ff None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:19.425939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-19c74e0a-c5df-4fc1-8d6a-254dc22e18ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:19.427743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=76adee13619c4c18a600704ce4487a8f, user_id=6b160a08080b4ec2bdfc8bf74b18351e, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:19.431641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:19.470830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 874/1724] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:19.472393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e6dd-f9ed-4c33-8c82-32f27855720b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:19.472681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e6dd-f9ed-4c33-8c82-32f27855720b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:19.472964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461e6dd-f9ed-4c33-8c82-32f27855720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:19.476188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 851/1725] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:19 2022] PUT /identity/v3/projects/76adee13619c4c18a600704ce4487a8f/users/6b160a08080b4ec2bdfc8bf74b18351e/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:19.477429 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:19.488991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:19.531899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5461e6dd-f9ed-4c33-8c82-32f27855720b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:19.533117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5461e6dd-f9ed-4c33-8c82-32f27855720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:19.610574 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd5f4-4318-40b7-9160-a3911b5c32ae admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:19.621613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:19.624650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:19.625337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:19.625825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:19.727879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 875/1726] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:19.730554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b0a4d-cc51-4d53-91de-6bd3c6984ef7 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:19.730851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b0a4d-cc51-4d53-91de-6bd3c6984ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:19.733977 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b0a4d-cc51-4d53-91de-6bd3c6984ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:19.791156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:19.793052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:19.814287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 852/1727] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:19 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:19.815732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:19.819913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:19.826522 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ef8b0a4d-cc51-4d53-91de-6bd3c6984ef7 None None] MFA Rules not processed for user `6b160a08080b4ec2bdfc8bf74b18351e`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:19.828043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ef8b0a4d-cc51-4d53-91de-6bd3c6984ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:19.970628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b95277-b808-4bb0-b1e8-306942bb65cf service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:19.982590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f10c15-78e6-4b5e-b0c6-2d09a9254e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:19.983598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f10c15-78e6-4b5e-b0c6-2d09a9254e8d service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:19.983895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f10c15-78e6-4b5e-b0c6-2d09a9254e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:19.984167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f10c15-78e6-4b5e-b0c6-2d09a9254e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:19.998175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f10c15-78e6-4b5e-b0c6-2d09a9254e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:20.000808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f10c15-78e6-4b5e-b0c6-2d09a9254e8d service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:20.017596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 853/1728] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:20.020002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 876/1729] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:20.020104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b0a4d-cc51-4d53-91de-6bd3c6984ef7 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:20.024681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ef8b0a4d-cc51-4d53-91de-6bd3c6984ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:20.024822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90b6b-2f45-48d9-8880-19176de124a6 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:20.025107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90b6b-2f45-48d9-8880-19176de124a6 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:20.025385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90b6b-2f45-48d9-8880-19176de124a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:20.050868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d5c90b6b-2f45-48d9-8880-19176de124a6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:20.052408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d5c90b6b-2f45-48d9-8880-19176de124a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:20.060087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b0a4d-cc51-4d53-91de-6bd3c6984ef7 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:20.063598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 854/1730] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:20.068722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90b6b-2f45-48d9-8880-19176de124a6 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:20.069809 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:20.071904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:20.073847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:20.074377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] PATH_INFO: `/v3/users/b38840931f7443a89b8dfa160d8088bf` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:20.080293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38840931f7443a89b8dfa160d8088bf)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:20.080781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90b6b-2f45-48d9-8880-19176de124a6 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:20.086566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:20.087337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:20.087615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:20.087995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:20.089027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:20.089410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:20.091139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:20.091405 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:20.106467 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 855/1731] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:20.111716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:20.124261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb308bfb-1894-4b02-8126-dcff3e5c0a60 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:20.130690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:20.131461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:20.131811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:20.132151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:20.132921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:20.135258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:20.217564 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38840931f7443a89b8dfa160d8088bf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:20.231180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 856/1732] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:20 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:20.231180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:20.236302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:20.249817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38840931f7443a89b8dfa160d8088bf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:20.275899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38840931f7443a89b8dfa160d8088bf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:20.284599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38840931f7443a89b8dfa160d8088bf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:20.342955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38840931f7443a89b8dfa160d8088bf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:20.364106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 877/1733] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:20 2022] DELETE /identity/v3/users/b38840931f7443a89b8dfa160d8088bf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:20.369088 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:20.379400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:20.459775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ee452-6bf9-4f5e-9af2-71eefc480c74 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:20.650086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be784004-c393-4527-8a9a-7e73cbd9a422 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:20.671545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a099b-43f5-4d76-bf98-00db6c979453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:20.676723 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a099b-43f5-4d76-bf98-00db6c979453 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:20.677039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a099b-43f5-4d76-bf98-00db6c979453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:20.677324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a099b-43f5-4d76-bf98-00db6c979453 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:20.678047 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a099b-43f5-4d76-bf98-00db6c979453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:20.680055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a099b-43f5-4d76-bf98-00db6c979453 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:20.747092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 878/1734] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:20 2022] POST /identity/v3/users => generated 285 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:20.759309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5274-c58e-405a-a7a5-4c824b87c7d1 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:20.760080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5274-c58e-405a-a7a5-4c824b87c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:20.761921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5274-c58e-405a-a7a5-4c824b87c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:20.773666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:20.774863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:20.775321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:20.775741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:20.779208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:20.874242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-37ec5274-c58e-405a-a7a5-4c824b87c7d1 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:20.878798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-37ec5274-c58e-405a-a7a5-4c824b87c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:20.917519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 879/1735] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:20.917519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec5274-c58e-405a-a7a5-4c824b87c7d1 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:20.955917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec5274-c58e-405a-a7a5-4c824b87c7d1 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:20.971705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae952d54-5c19-478b-a34d-134aadca2843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:20.974598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952d54-5c19-478b-a34d-134aadca2843 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:20.975210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952d54-5c19-478b-a34d-134aadca2843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:20.977834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952d54-5c19-478b-a34d-134aadca2843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:20.978821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae952d54-5c19-478b-a34d-134aadca2843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:20.985342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae952d54-5c19-478b-a34d-134aadca2843 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:21.005562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:21.008761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:21.014640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 880/1736] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:21.019806 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae952d54-5c19-478b-a34d-134aadca2843 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:21.046398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae952d54-5c19-478b-a34d-134aadca2843 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:21.053828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 857/1737] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 824 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:21.059936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:21.063869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:21.065091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:21.065646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:21.066618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:21.070153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:21.102469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 881/1738] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:21.105969 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:21.129720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177de9d-f236-4c45-ab72-97eb2ff4c5ea service nova] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:21.152514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:21.155737 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:21.164609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61703e49-2397-4bcf-9719-cd7cf095bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:21.165558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61703e49-2397-4bcf-9719-cd7cf095bc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:21.165841 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61703e49-2397-4bcf-9719-cd7cf095bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:21.166119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61703e49-2397-4bcf-9719-cd7cf095bc59 admin admin] PATH_INFO: `/v3/projects/8f73e88fa5f242fe8a0aea55baed45f8/users/ad3ef47283af4bbe9b99fec17ddc8fda/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:21.240576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61703e49-2397-4bcf-9719-cd7cf095bc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f73e88fa5f242fe8a0aea55baed45f8, user_id=ad3ef47283af4bbe9b99fec17ddc8fda, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:21.247183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61703e49-2397-4bcf-9719-cd7cf095bc59 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:21.279068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 858/1739] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:21 2022] PUT /identity/v3/projects/8f73e88fa5f242fe8a0aea55baed45f8/users/ad3ef47283af4bbe9b99fec17ddc8fda/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:21.290464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ed3d-a253-47ec-a0a5-5ec6dc0534cc None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:21.291326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ed3d-a253-47ec-a0a5-5ec6dc0534cc None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:21.291326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ed3d-a253-47ec-a0a5-5ec6dc0534cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:21.350609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6879ed3d-a253-47ec-a0a5-5ec6dc0534cc None None] MFA Rules not processed for user `ad3ef47283af4bbe9b99fec17ddc8fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:21.352083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6879ed3d-a253-47ec-a0a5-5ec6dc0534cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:21.382371 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6c119-f0ae-4004-8f92-c00fd8df3868 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:21.598684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 859/1740] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:21.599472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296823e-d89f-4063-b64b-e03f15723d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:21.600154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296823e-d89f-4063-b64b-e03f15723d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:21.600428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296823e-d89f-4063-b64b-e03f15723d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:21.600709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296823e-d89f-4063-b64b-e03f15723d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:21.602421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ed3d-a253-47ec-a0a5-5ec6dc0534cc None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:21.815937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ed3d-a253-47ec-a0a5-5ec6dc0534cc None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:21.821885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7b9f-9001-4a03-9971-8872bcdf3e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:21.823019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7b9f-9001-4a03-9971-8872bcdf3e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:21.823671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7b9f-9001-4a03-9971-8872bcdf3e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:21.824317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7b9f-9001-4a03-9971-8872bcdf3e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:21.825322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c7b9f-9001-4a03-9971-8872bcdf3e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:21.828439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c7b9f-9001-4a03-9971-8872bcdf3e21 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:21.871362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 860/1741] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:21 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:21.876386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7b9f-9001-4a03-9971-8872bcdf3e21 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:21.894697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296823e-d89f-4063-b64b-e03f15723d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:21.896273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296823e-d89f-4063-b64b-e03f15723d5d service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:21.928185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 882/1742] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:21.990990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7b9f-9001-4a03-9971-8872bcdf3e21 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:22.030052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8173-fdf7-4549-9915-570dea58843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:22.035664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8173-fdf7-4549-9915-570dea58843a admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:22.036705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8173-fdf7-4549-9915-570dea58843a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:22.040227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec8173-fdf7-4549-9915-570dea58843a admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:22.043457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8173-fdf7-4549-9915-570dea58843a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:22.051453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec8173-fdf7-4549-9915-570dea58843a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:22.109045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 861/1743] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:21 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:22.113502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296823e-d89f-4063-b64b-e03f15723d5d service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:22.124417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296823e-d89f-4063-b64b-e03f15723d5d service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:22.145111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ffcb-1cec-4840-a3d4-0f181a338ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:22.145803 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ffcb-1cec-4840-a3d4-0f181a338ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:22.146102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ffcb-1cec-4840-a3d4-0f181a338ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:22.146381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ffcb-1cec-4840-a3d4-0f181a338ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:22.147160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ffcb-1cec-4840-a3d4-0f181a338ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:22.151340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ffcb-1cec-4840-a3d4-0f181a338ca0 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:22.193541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8173-fdf7-4549-9915-570dea58843a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:22.195870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 883/1744] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:22.215062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec8173-fdf7-4549-9915-570dea58843a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:22.226067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754248f-00d5-496f-ab00-4d43b5508d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:22.227087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754248f-00d5-496f-ab00-4d43b5508d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:22.227503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754248f-00d5-496f-ab00-4d43b5508d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:22.227893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754248f-00d5-496f-ab00-4d43b5508d62 admin admin] PATH_INFO: `/v3/projects/9594d45e83a64f2b8d7a50a9ae494974/users/8abe1944a07c4b0d8d46862f1de2bb3c/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:22.262159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754248f-00d5-496f-ab00-4d43b5508d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9594d45e83a64f2b8d7a50a9ae494974, user_id=8abe1944a07c4b0d8d46862f1de2bb3c, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:22.265226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754248f-00d5-496f-ab00-4d43b5508d62 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:22.288425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 862/1745] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:22 2022] PUT /identity/v3/projects/9594d45e83a64f2b8d7a50a9ae494974/users/8abe1944a07c4b0d8d46862f1de2bb3c/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:22.293227 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ffcb-1cec-4840-a3d4-0f181a338ca0 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:22.308335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ffcb-1cec-4840-a3d4-0f181a338ca0 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:22.550751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:22.551719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:22.555147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:22.555736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:22.556734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:22.559782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:22.587022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 884/1746] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:22.590202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754248f-00d5-496f-ab00-4d43b5508d62 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:22.608119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754248f-00d5-496f-ab00-4d43b5508d62 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:22.617850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:22.619970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:22.634076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1526a-a51f-4182-8d41-8cfd45f99d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:22.635323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1526a-a51f-4182-8d41-8cfd45f99d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:22.639564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1526a-a51f-4182-8d41-8cfd45f99d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:22.642766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1526a-a51f-4182-8d41-8cfd45f99d25 admin admin] PATH_INFO: `/v3/projects/9594d45e83a64f2b8d7a50a9ae494974/users/8abe1944a07c4b0d8d46862f1de2bb3c/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:22.648600 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1526a-a51f-4182-8d41-8cfd45f99d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9594d45e83a64f2b8d7a50a9ae494974, user_id=8abe1944a07c4b0d8d46862f1de2bb3c, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:22.653816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1526a-a51f-4182-8d41-8cfd45f99d25 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:22.655820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d0ac-d44a-40ea-9a0c-2efdc314eb18 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:22.684837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:22.685931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:22.686343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:22.686723 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] PATH_INFO: `/v3/projects/32b54a160e0b4cfd993ea9fad29b8b3a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:22.694201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b54a160e0b4cfd993ea9fad29b8b3a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:22.696504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:22.706533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 863/1747] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:22 2022] PUT /identity/v3/projects/9594d45e83a64f2b8d7a50a9ae494974/users/8abe1944a07c4b0d8d46862f1de2bb3c/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:22.718503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69db89-55ed-4481-b6e1-1b935da9574b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:22.719733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69db89-55ed-4481-b6e1-1b935da9574b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:22.721012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69db89-55ed-4481-b6e1-1b935da9574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:22.820002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-7c69db89-55ed-4481-b6e1-1b935da9574b None None] MFA Rules not processed for user `8abe1944a07c4b0d8d46862f1de2bb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:22.831261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7c69db89-55ed-4481-b6e1-1b935da9574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:22.873774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b54a160e0b4cfd993ea9fad29b8b3a', 'request_id': 'req-f4129649-5958-45cb-a97b-1b131f666ad5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:22.892997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b54a160e0b4cfd993ea9fad29b8b3a', 'request_id': 'req-f4129649-5958-45cb-a97b-1b131f666ad5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:22.913077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b54a160e0b4cfd993ea9fad29b8b3a', 'request_id': 'req-f4129649-5958-45cb-a97b-1b131f666ad5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:22.955003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 864/1748] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:22.959633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] The token cache is being invalidate because project 32b54a160e0b4cfd993ea9fad29b8b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:22.960741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:22.962155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:22.969629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69db89-55ed-4481-b6e1-1b935da9574b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:22.970810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7c69db89-55ed-4481-b6e1-1b935da9574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:22.971962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 885/1749] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:22 2022] DELETE /identity/v3/projects/32b54a160e0b4cfd993ea9fad29b8b3a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:22.973378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:22.975406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:23.092704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69db89-55ed-4481-b6e1-1b935da9574b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:23.108927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:23.110367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:23.110801 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:23.111244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:23.113345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:23.123817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129649-5958-45cb-a97b-1b131f666ad5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:23.135468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:23.136312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:23.137840 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:23.138665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:23.139357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] PATH_INFO: `/v3/users/16befa2b1f094a3fba85f75b52927a80` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:23.140026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:23.142068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=16befa2b1f094a3fba85f75b52927a80)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:23.145597 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:23.169204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 865/1750] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:23.293092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16befa2b1f094a3fba85f75b52927a80'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.304322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16befa2b1f094a3fba85f75b52927a80'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.316820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16befa2b1f094a3fba85f75b52927a80'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.317902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16befa2b1f094a3fba85f75b52927a80'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.348813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e092ac8b-51e2-4ffc-8dd0-6486933cac8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16befa2b1f094a3fba85f75b52927a80'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.393012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 886/1751] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:22 2022] DELETE /identity/v3/users/16befa2b1f094a3fba85f75b52927a80 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:23.668216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:23.669896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:23.684086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627a28d-66eb-4dae-8633-92f1466d130e service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:23.755478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:23.756629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:23.757117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:23.757594 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] PATH_INFO: `/v3/projects/fb5dac2161dd464bb340646dd9386fdb` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:23.759758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5dac2161dd464bb340646dd9386fdb)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:23.762418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:23.829553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5dac2161dd464bb340646dd9386fdb', 'request_id': 'req-1e5454ec-a128-4fe9-bf78-819087604631'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.856250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5dac2161dd464bb340646dd9386fdb', 'request_id': 'req-1e5454ec-a128-4fe9-bf78-819087604631'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.868227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5dac2161dd464bb340646dd9386fdb', 'request_id': 'req-1e5454ec-a128-4fe9-bf78-819087604631'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.884412 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] The token cache is being invalidate because project fb5dac2161dd464bb340646dd9386fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:23.885115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.885991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:23.894941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ebae-f13c-4c85-93e3-c913e2f5a905 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:23.895730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ebae-f13c-4c85-93e3-c913e2f5a905 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:23.896357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15ebae-f13c-4c85-93e3-c913e2f5a905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:23.898624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 866/1752] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:23 2022] DELETE /identity/v3/projects/fb5dac2161dd464bb340646dd9386fdb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:23.930482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fa15ebae-f13c-4c85-93e3-c913e2f5a905 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:23.932268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fa15ebae-f13c-4c85-93e3-c913e2f5a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:23.973692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:23.976550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:24.055020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 887/1753] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:24.056632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e09d-d93e-4ea0-ad26-79c2b59cbb4a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:24.056986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e09d-d93e-4ea0-ad26-79c2b59cbb4a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:24.057285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e09d-d93e-4ea0-ad26-79c2b59cbb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:24.122947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-70f1e09d-d93e-4ea0-ad26-79c2b59cbb4a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:24.131347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-70f1e09d-d93e-4ea0-ad26-79c2b59cbb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:24.162201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 888/1754] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:24.167485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1e09d-d93e-4ea0-ad26-79c2b59cbb4a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:24.197707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1e09d-d93e-4ea0-ad26-79c2b59cbb4a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:24.241042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5454ec-a128-4fe9-bf78-819087604631 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:24.244496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:24.245140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:24.245422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:24.245693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:24.247098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:24.254627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:24.266015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:24.279335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:24.282689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:24.286548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:24.293486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] PATH_INFO: `/v3/users/ad3ef47283af4bbe9b99fec17ddc8fda` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:24.295414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3ef47283af4bbe9b99fec17ddc8fda)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:24.312643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:24.329474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 889/1755] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:24.330375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:24.339622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:24.363503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9f818-1558-4c04-9065-9e5f878e3e1b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:24.397747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:24.407332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:24.407807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:24.408191 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] PATH_INFO: `/v3/users/6b160a08080b4ec2bdfc8bf74b18351e` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:24.411341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b160a08080b4ec2bdfc8bf74b18351e)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:24.413808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:24.476942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3ef47283af4bbe9b99fec17ddc8fda'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.491832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3ef47283af4bbe9b99fec17ddc8fda'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.502906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3ef47283af4bbe9b99fec17ddc8fda'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.504074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3ef47283af4bbe9b99fec17ddc8fda'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.526277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3ef47283af4bbe9b99fec17ddc8fda'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.540193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 867/1756] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:23 2022] DELETE /identity/v3/users/ad3ef47283af4bbe9b99fec17ddc8fda => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:24.541484 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:24.547681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:24.564512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b160a08080b4ec2bdfc8bf74b18351e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.578513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b160a08080b4ec2bdfc8bf74b18351e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.601891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b160a08080b4ec2bdfc8bf74b18351e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.602539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b160a08080b4ec2bdfc8bf74b18351e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.636647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0c37c736-83f3-4cb2-ba25-a012920cad5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b160a08080b4ec2bdfc8bf74b18351e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:24.656185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 890/1757] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:24 2022] DELETE /identity/v3/users/6b160a08080b4ec2bdfc8bf74b18351e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:24.661654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763870-be84-4cc1-8cdf-effe41bc5231 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:24.661654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763870-be84-4cc1-8cdf-effe41bc5231 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:24.667890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763870-be84-4cc1-8cdf-effe41bc5231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:24.728051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-da763870-be84-4cc1-8cdf-effe41bc5231 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:24.730252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-da763870-be84-4cc1-8cdf-effe41bc5231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:24.846025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 891/1758] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:24.852432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ce06f-8f2d-4758-97ec-c52955a14148 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:24.853437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ce06f-8f2d-4758-97ec-c52955a14148 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:24.853983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ce06f-8f2d-4758-97ec-c52955a14148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:24.876736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c90ce06f-8f2d-4758-97ec-c52955a14148 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:24.878099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c90ce06f-8f2d-4758-97ec-c52955a14148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:24.896397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 892/1759] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:24.897493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ce06f-8f2d-4758-97ec-c52955a14148 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:24.899016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c90ce06f-8f2d-4758-97ec-c52955a14148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:24.954150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d67d7a-f5a7-4f20-9710-e9f28a828584 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:24.960922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:24.961969 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:24.962444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:24.962919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:24.964449 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:24.967701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:24.990871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ce06f-8f2d-4758-97ec-c52955a14148 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.000271 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f441d-bd1b-4f35-bb20-6dbebb4fbed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.001190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f441d-bd1b-4f35-bb20-6dbebb4fbed4 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.001718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f441d-bd1b-4f35-bb20-6dbebb4fbed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.009012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f441d-bd1b-4f35-bb20-6dbebb4fbed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.019373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 868/1760] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:24 2022] POST /identity/v3/projects => generated 375 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:25.020856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.027947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.028164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f441d-bd1b-4f35-bb20-6dbebb4fbed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.029841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f441d-bd1b-4f35-bb20-6dbebb4fbed4 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.041847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 893/1761] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:25.044111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3e85-48d8-4494-bc42-723084a72d95 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.044815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3e85-48d8-4494-bc42-723084a72d95 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.045267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec3e85-48d8-4494-bc42-723084a72d95 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.047343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 894/1762] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:45:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:45:25.048075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec3e85-48d8-4494-bc42-723084a72d95 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.050468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2aec3e85-48d8-4494-bc42-723084a72d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.125506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d86a-5141-42ee-9822-b42d9802a184 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.130789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d7adf-0bdc-4a80-b2af-d96d188b8976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.131808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7adf-0bdc-4a80-b2af-d96d188b8976 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.132398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7adf-0bdc-4a80-b2af-d96d188b8976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.132837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7adf-0bdc-4a80-b2af-d96d188b8976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.156772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec3e85-48d8-4494-bc42-723084a72d95 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.163748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.165398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.165850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.168163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.169194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.171682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.215128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 895/1763] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:25 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:25.216301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.219341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.240119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad03c0-c2ec-425b-a256-19732dd5eee2 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.247935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.249641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.250500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.250922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] PATH_INFO: `/v3/projects/9d9fc5625c5a42fbaf0c80cbfdce7528` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.252891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9fc5625c5a42fbaf0c80cbfdce7528)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.254531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d7adf-0bdc-4a80-b2af-d96d188b8976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.255309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.258087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d7adf-0bdc-4a80-b2af-d96d188b8976 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.274717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 869/1764] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:25.276579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156acd-447e-4b1c-baf5-3879e1c7c00b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.277529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156acd-447e-4b1c-baf5-3879e1c7c00b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.278009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156acd-447e-4b1c-baf5-3879e1c7c00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.325338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-9a156acd-447e-4b1c-baf5-3879e1c7c00b None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:25.331157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9a156acd-447e-4b1c-baf5-3879e1c7c00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.388042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9fc5625c5a42fbaf0c80cbfdce7528', 'request_id': 'req-990b99f6-5364-4e66-bb21-404dc1e7a641'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:25.401855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9fc5625c5a42fbaf0c80cbfdce7528', 'request_id': 'req-990b99f6-5364-4e66-bb21-404dc1e7a641'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:25.407910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9fc5625c5a42fbaf0c80cbfdce7528', 'request_id': 'req-990b99f6-5364-4e66-bb21-404dc1e7a641'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:25.412737 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 870/1765] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:25.413607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a156acd-447e-4b1c-baf5-3879e1c7c00b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.425656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a156acd-447e-4b1c-baf5-3879e1c7c00b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.436499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] The token cache is being invalidate because project 9d9fc5625c5a42fbaf0c80cbfdce7528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:25.436499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:25.437053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-990b99f6-5364-4e66-bb21-404dc1e7a641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:25.439460 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 896/1766] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:25 2022] DELETE /identity/v3/projects/9d9fc5625c5a42fbaf0c80cbfdce7528 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:25.444857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deace8-79e2-4c7c-a6c9-47bf31f47a75 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.444857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deace8-79e2-4c7c-a6c9-47bf31f47a75 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.444857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deace8-79e2-4c7c-a6c9-47bf31f47a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.497293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e7deace8-79e2-4c7c-a6c9-47bf31f47a75 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:25.508917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e7deace8-79e2-4c7c-a6c9-47bf31f47a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.591975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.592575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.592854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.593124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.594050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.599759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.630480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 871/1767] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:25.638003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 897/1768] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:25.644611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.644611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.647769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad649-97e8-4f1a-9999-b8d3dffc9e3d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.648219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad649-97e8-4f1a-9999-b8d3dffc9e3d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.648659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dad649-97e8-4f1a-9999-b8d3dffc9e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.654191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba8e6f-9ed1-4245-8433-36b3bd304f67 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.663632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342148c-abad-4ae3-93be-366e24fd0328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.664319 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342148c-abad-4ae3-93be-366e24fd0328 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.664601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342148c-abad-4ae3-93be-366e24fd0328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.664932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342148c-abad-4ae3-93be-366e24fd0328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.666955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342148c-abad-4ae3-93be-366e24fd0328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.668786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342148c-abad-4ae3-93be-366e24fd0328 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.686857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 872/1769] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:25.688857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342148c-abad-4ae3-93be-366e24fd0328 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.692162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d9dad649-97e8-4f1a-9999-b8d3dffc9e3d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:25.693493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d9dad649-97e8-4f1a-9999-b8d3dffc9e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.710531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 898/1770] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:25.714579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad649-97e8-4f1a-9999-b8d3dffc9e3d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.722018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342148c-abad-4ae3-93be-366e24fd0328 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.726024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dad649-97e8-4f1a-9999-b8d3dffc9e3d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.733145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802ae07-e51f-40e4-b208-d92581cd54dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.735356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ae07-e51f-40e4-b208-d92581cd54dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.735756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ae07-e51f-40e4-b208-d92581cd54dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.735930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.736835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.737323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ae07-e51f-40e4-b208-d92581cd54dd admin admin] PATH_INFO: `/v3/projects/039982fac968482085e7e0cba11b9cb8/users/89ed0ec1b7374dab892cda90c197a841/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.739991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.740333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.741280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:25.742082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.743922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.767071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802ae07-e51f-40e4-b208-d92581cd54dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=039982fac968482085e7e0cba11b9cb8, user_id=89ed0ec1b7374dab892cda90c197a841, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.770611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802ae07-e51f-40e4-b208-d92581cd54dd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.771853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 899/1771] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:45:25.773049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.787442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b568fc0-1398-44ba-b840-2bce0711125c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:25.804794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 873/1772] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:25 2022] PUT /identity/v3/projects/039982fac968482085e7e0cba11b9cb8/users/89ed0ec1b7374dab892cda90c197a841/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:25.807620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03afd-8f73-40bb-b1fb-3d2dc25dfe8d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.808059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03afd-8f73-40bb-b1fb-3d2dc25dfe8d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.808712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03afd-8f73-40bb-b1fb-3d2dc25dfe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.850637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-a5f03afd-8f73-40bb-b1fb-3d2dc25dfe8d None None] MFA Rules not processed for user `89ed0ec1b7374dab892cda90c197a841`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:25.852031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a5f03afd-8f73-40bb-b1fb-3d2dc25dfe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.897144 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:25.898050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:25.898634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:25.899137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:25.900127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:25.902273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:25.946877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 900/1773] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:25 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:25.948320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.956125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 874/1774] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:25.957191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f03afd-8f73-40bb-b1fb-3d2dc25dfe8d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:25.958051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:25.972210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f03afd-8f73-40bb-b1fb-3d2dc25dfe8d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.065316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487f67-4665-4de4-addb-5f603b13318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.066777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487f67-4665-4de4-addb-5f603b13318a admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.067308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487f67-4665-4de4-addb-5f603b13318a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.067919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487f67-4665-4de4-addb-5f603b13318a admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.069679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9487f67-4665-4de4-addb-5f603b13318a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.074359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9487f67-4665-4de4-addb-5f603b13318a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.112774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 875/1775] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:25 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:26.113964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487f67-4665-4de4-addb-5f603b13318a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.127247 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487f67-4665-4de4-addb-5f603b13318a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.133360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7cece-dcf1-4231-b9aa-8df78bcb92f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.133955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7cece-dcf1-4231-b9aa-8df78bcb92f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.134370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7cece-dcf1-4231-b9aa-8df78bcb92f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.134932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7cece-dcf1-4231-b9aa-8df78bcb92f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.135439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7cece-dcf1-4231-b9aa-8df78bcb92f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.137369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7cece-dcf1-4231-b9aa-8df78bcb92f0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.141539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3fff-366e-4a5b-bc2d-9d79e85e2d16 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.149113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.150172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.150665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.151156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.153345 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:26.167053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.169429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.183320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 901/1776] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:26.184192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.185848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 876/1777] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:26 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:26.186742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7cece-dcf1-4231-b9aa-8df78bcb92f0 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.208942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e4360-807b-4401-ae7d-8726c9a26911 service nova] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.294845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bcd30-8c8b-4598-af97-bc6a8e077d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.296440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcd30-8c8b-4598-af97-bc6a8e077d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.298178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcd30-8c8b-4598-af97-bc6a8e077d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.301574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bcd30-8c8b-4598-af97-bc6a8e077d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.302385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bcd30-8c8b-4598-af97-bc6a8e077d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.304136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bcd30-8c8b-4598-af97-bc6a8e077d09 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.319446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7cece-dcf1-4231-b9aa-8df78bcb92f0 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.321185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 902/1778] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:26.326165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bcd30-8c8b-4598-af97-bc6a8e077d09 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.337858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.337858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.337858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.337858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.338342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.341348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.358185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bcd30-8c8b-4598-af97-bc6a8e077d09 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.370439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 877/1779] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:26 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:26.372129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.374667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:26.386270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714802-1dbe-4607-8d44-8f4884674f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.387434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714802-1dbe-4607-8d44-8f4884674f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.387834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714802-1dbe-4607-8d44-8f4884674f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.388572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd714802-1dbe-4607-8d44-8f4884674f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.388686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0c6e1-dd35-4e25-bf03-102fd89ab315 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.394629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.394916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.395131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.395409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] PATH_INFO: `/v3/projects/76adee13619c4c18a600704ce4487a8f` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.395955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd714802-1dbe-4607-8d44-8f4884674f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.396936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76adee13619c4c18a600704ce4487a8f)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.397651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd714802-1dbe-4607-8d44-8f4884674f79 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.398865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.424606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 903/1780] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:26.424606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714802-1dbe-4607-8d44-8f4884674f79 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.436849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd714802-1dbe-4607-8d44-8f4884674f79 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.453522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76adee13619c4c18a600704ce4487a8f', 'request_id': 'req-0104376e-fbdc-41dc-a011-c5639098b48a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.479505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76adee13619c4c18a600704ce4487a8f', 'request_id': 'req-0104376e-fbdc-41dc-a011-c5639098b48a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.490538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76adee13619c4c18a600704ce4487a8f', 'request_id': 'req-0104376e-fbdc-41dc-a011-c5639098b48a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.504576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] The token cache is being invalidate because project 76adee13619c4c18a600704ce4487a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:26.504862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.505539 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.507404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 878/1781] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:26 2022] DELETE /identity/v3/projects/76adee13619c4c18a600704ce4487a8f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:26.507916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.509207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:26.547698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.548419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.548780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.561941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.563336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.564994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.583481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104376e-fbdc-41dc-a011-c5639098b48a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.588716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18458d-f979-4b3c-a38b-2391e4196236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.589762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18458d-f979-4b3c-a38b-2391e4196236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.590253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18458d-f979-4b3c-a38b-2391e4196236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.590603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18458d-f979-4b3c-a38b-2391e4196236 admin admin] PATH_INFO: `/v3/projects/3acbfb0b6c7545b386a3dbf9c0bbd1be/users/233e094e2513433fa95ed988533ea8d4/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.591732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 904/1782] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:26.592697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.603255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:26.620777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18458d-f979-4b3c-a38b-2391e4196236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acbfb0b6c7545b386a3dbf9c0bbd1be, user_id=233e094e2513433fa95ed988533ea8d4, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.623791 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18458d-f979-4b3c-a38b-2391e4196236 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.625979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24b57b-bccc-43f1-802b-32fa8cd44ba7 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.639795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.641253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.641541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.641810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] PATH_INFO: `/v3/projects/8f73e88fa5f242fe8a0aea55baed45f8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.645097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 879/1783] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:26 2022] PUT /identity/v3/projects/3acbfb0b6c7545b386a3dbf9c0bbd1be/users/233e094e2513433fa95ed988533ea8d4/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:26.646411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472be4-0899-461c-b9a5-54069d968124 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.646537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f73e88fa5f242fe8a0aea55baed45f8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.646629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472be4-0899-461c-b9a5-54069d968124 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.646895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472be4-0899-461c-b9a5-54069d968124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.648322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.686774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-82472be4-0899-461c-b9a5-54069d968124 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:26.700134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-82472be4-0899-461c-b9a5-54069d968124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:26.769451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f73e88fa5f242fe8a0aea55baed45f8', 'request_id': 'req-4709e4b1-7623-4890-a649-3c6b0be9dc98'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.786071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f73e88fa5f242fe8a0aea55baed45f8', 'request_id': 'req-4709e4b1-7623-4890-a649-3c6b0be9dc98'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.795376 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f73e88fa5f242fe8a0aea55baed45f8', 'request_id': 'req-4709e4b1-7623-4890-a649-3c6b0be9dc98'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.808776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 880/1784] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:26.809988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472be4-0899-461c-b9a5-54069d968124 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.811594 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-82472be4-0899-461c-b9a5-54069d968124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:26.824516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] The token cache is being invalidate because project 8f73e88fa5f242fe8a0aea55baed45f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:26.824970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.825121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472be4-0899-461c-b9a5-54069d968124 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:26.825860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4709e4b1-7623-4890-a649-3c6b0be9dc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:26.831107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 905/1785] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:26 2022] DELETE /identity/v3/projects/8f73e88fa5f242fe8a0aea55baed45f8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:26.832732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2323a-0bdd-4a54-a175-2ee72d89c20b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.833110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2323a-0bdd-4a54-a175-2ee72d89c20b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.833531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2323a-0bdd-4a54-a175-2ee72d89c20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.864436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c6b2323a-0bdd-4a54-a175-2ee72d89c20b None None] MFA Rules not processed for user `233e094e2513433fa95ed988533ea8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:26.865686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c6b2323a-0bdd-4a54-a175-2ee72d89c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:26.909995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:26.911014 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.911357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.911699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] PATH_INFO: `/v3/projects/508d974083e94ff8ab308fc180cb65e5/users/8b5c52b1e41e4f01bd276cacc30026a1/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.933225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=508d974083e94ff8ab308fc180cb65e5, user_id=8b5c52b1e41e4f01bd276cacc30026a1, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:26.936244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:26.956485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 906/1786] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:26.958848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07910b1-e93b-4763-8d82-24d4994eda34 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:26.959305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07910b1-e93b-4763-8d82-24d4994eda34 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:26.960147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07910b1-e93b-4763-8d82-24d4994eda34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:26.963732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 881/1787] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:26 2022] PUT /identity/v3/projects/508d974083e94ff8ab308fc180cb65e5/users/8b5c52b1e41e4f01bd276cacc30026a1/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:26.964904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:26.966654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:26.986403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f07910b1-e93b-4763-8d82-24d4994eda34 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:26.987996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f07910b1-e93b-4763-8d82-24d4994eda34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.060305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eb48a-bf83-483a-879d-567ec4861f0e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.071440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.072933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.073218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.073496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] PATH_INFO: `/v3/users/8abe1944a07c4b0d8d46862f1de2bb3c` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.076586 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8abe1944a07c4b0d8d46862f1de2bb3c)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.080767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 907/1788] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:27.080767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07910b1-e93b-4763-8d82-24d4994eda34 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.082562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f07910b1-e93b-4763-8d82-24d4994eda34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.085814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.098726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07910b1-e93b-4763-8d82-24d4994eda34 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.103496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.104259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.104604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.104944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.106324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.108801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.145617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 908/1789] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:27 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:27.146397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.148300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.158295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8abe1944a07c4b0d8d46862f1de2bb3c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:27.168130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8abe1944a07c4b0d8d46862f1de2bb3c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:27.180273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8abe1944a07c4b0d8d46862f1de2bb3c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:27.181753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8abe1944a07c4b0d8d46862f1de2bb3c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:27.203348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8abe1944a07c4b0d8d46862f1de2bb3c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:27.212496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 882/1790] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:26 2022] DELETE /identity/v3/users/8abe1944a07c4b0d8d46862f1de2bb3c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:27.213402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.215582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.235655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3c75-b305-4384-9ad5-4fc2e26c4f7c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.316683 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ac183-2336-48f2-b7f5-1292c6f378f6 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.322852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.323604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.323752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.324111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.324266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.324550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.324656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.324823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.325578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:27.325689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.326046 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.327413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.329185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.339605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 909/1791] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:27.341036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.342856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.357003 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d5623-0104-4252-89fd-623fb9c9f69b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.360275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 883/1792] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:27.363795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.365792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a0d65-7f07-4aa2-942d-c70b009fd504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.367057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a0d65-7f07-4aa2-942d-c70b009fd504 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.367057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a0d65-7f07-4aa2-942d-c70b009fd504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.367271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.367350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a0d65-7f07-4aa2-942d-c70b009fd504 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.367927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a0d65-7f07-4aa2-942d-c70b009fd504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.369627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a0d65-7f07-4aa2-942d-c70b009fd504 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.388084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fd678-9a0c-4cd6-be03-c6c172083eeb admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.390932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 910/1793] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:27 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:27.391819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a0d65-7f07-4aa2-942d-c70b009fd504 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.393924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec695d12-0e99-4fcf-bca8-5ec0284dd760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.394752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec695d12-0e99-4fcf-bca8-5ec0284dd760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.395122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec695d12-0e99-4fcf-bca8-5ec0284dd760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.395465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec695d12-0e99-4fcf-bca8-5ec0284dd760 admin admin] PATH_INFO: `/v3/projects/508d974083e94ff8ab308fc180cb65e5/users/8b5c52b1e41e4f01bd276cacc30026a1/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.399879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec695d12-0e99-4fcf-bca8-5ec0284dd760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508d974083e94ff8ab308fc180cb65e5, user_id=8b5c52b1e41e4f01bd276cacc30026a1, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.401857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a0d65-7f07-4aa2-942d-c70b009fd504 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.403169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec695d12-0e99-4fcf-bca8-5ec0284dd760 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.407420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93f14f-5ef9-4ed2-8ee2-2a020aa0a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.408087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93f14f-5ef9-4ed2-8ee2-2a020aa0a6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.408369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93f14f-5ef9-4ed2-8ee2-2a020aa0a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.408696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93f14f-5ef9-4ed2-8ee2-2a020aa0a6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.410867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93f14f-5ef9-4ed2-8ee2-2a020aa0a6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.413247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93f14f-5ef9-4ed2-8ee2-2a020aa0a6c2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.424221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 884/1794] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:27 2022] PUT /identity/v3/projects/508d974083e94ff8ab308fc180cb65e5/users/8b5c52b1e41e4f01bd276cacc30026a1/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:27.434715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec695d12-0e99-4fcf-bca8-5ec0284dd760 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.516286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 911/1795] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:27 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:27.519637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5abdb-0d8e-49f0-9f3b-dd7acd70ac5a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.520938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5abdb-0d8e-49f0-9f3b-dd7acd70ac5a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.521542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5abdb-0d8e-49f0-9f3b-dd7acd70ac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.573958 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec695d12-0e99-4fcf-bca8-5ec0284dd760 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.586098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ded5abdb-0d8e-49f0-9f3b-dd7acd70ac5a None None] MFA Rules not processed for user `8b5c52b1e41e4f01bd276cacc30026a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:27.590985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ded5abdb-0d8e-49f0-9f3b-dd7acd70ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.689939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.691214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.691572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.692049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.692972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.695093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.723219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 912/1796] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:27.725583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5abdb-0d8e-49f0-9f3b-dd7acd70ac5a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.727313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 885/1797] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:27.731650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.733660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.738996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5abdb-0d8e-49f0-9f3b-dd7acd70ac5a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.750028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c76a3-a4d0-4612-a4c4-f49bb385a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.752748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c76a3-a4d0-4612-a4c4-f49bb385a7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.753261 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c76a3-a4d0-4612-a4c4-f49bb385a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.753720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c76a3-a4d0-4612-a4c4-f49bb385a7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.756202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c76a3-a4d0-4612-a4c4-f49bb385a7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.760663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c76a3-a4d0-4612-a4c4-f49bb385a7a3 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.807764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 913/1798] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:27 2022] POST /identity/v3/users => generated 290 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:27.807970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c76a3-a4d0-4612-a4c4-f49bb385a7a3 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.824758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c76a3-a4d0-4612-a4c4-f49bb385a7a3 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.830935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736159f-6c23-4679-94ad-542a9141156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.832229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736159f-6c23-4679-94ad-542a9141156d admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.832618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736159f-6c23-4679-94ad-542a9141156d admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.833299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736159f-6c23-4679-94ad-542a9141156d admin admin] PATH_INFO: `/v3/projects/701b1e56f6734c1396748b4bd81303be/users/9f0214dd79cb427cb881d6372cbe5742/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.862651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736159f-6c23-4679-94ad-542a9141156d admin admin] RBAC: Authorizing `identity:create_grant(project_id=701b1e56f6734c1396748b4bd81303be, user_id=9f0214dd79cb427cb881d6372cbe5742, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:27.865766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736159f-6c23-4679-94ad-542a9141156d admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:27.868476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53354-3177-458d-86cd-d642242dde90 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:27.883462 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:27.885639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:27.885925 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:27.887119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:27.891937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:27.900806 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 914/1799] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:27 2022] PUT /identity/v3/projects/701b1e56f6734c1396748b4bd81303be/users/9f0214dd79cb427cb881d6372cbe5742/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:27.900806 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736159f-6c23-4679-94ad-542a9141156d admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:27.995334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736159f-6c23-4679-94ad-542a9141156d admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.002983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdcfcb-5a96-428e-9a3f-8811dfae5a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.003715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdcfcb-5a96-428e-9a3f-8811dfae5a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.004005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdcfcb-5a96-428e-9a3f-8811dfae5a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.004335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdcfcb-5a96-428e-9a3f-8811dfae5a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.005137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdcfcb-5a96-428e-9a3f-8811dfae5a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.009090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdcfcb-5a96-428e-9a3f-8811dfae5a52 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.024862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 915/1800] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:28.027075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdcfcb-5a96-428e-9a3f-8811dfae5a52 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.032714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.032714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.044265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 886/1801] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:28.045274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.054494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdcfcb-5a96-428e-9a3f-8811dfae5a52 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.060354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22b2c5-4af1-47b0-8e70-7e2648902cb9 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.065864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e093fad-7e63-43e8-bb22-812bc8969f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.066547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093fad-7e63-43e8-bb22-812bc8969f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.066827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093fad-7e63-43e8-bb22-812bc8969f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.067133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093fad-7e63-43e8-bb22-812bc8969f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.067865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e093fad-7e63-43e8-bb22-812bc8969f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.069622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e093fad-7e63-43e8-bb22-812bc8969f23 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.073610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6edbd-c80c-4ceb-be37-655624e5b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.074290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6edbd-c80c-4ceb-be37-655624e5b8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.074572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6edbd-c80c-4ceb-be37-655624e5b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.074835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6edbd-c80c-4ceb-be37-655624e5b8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.076576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6edbd-c80c-4ceb-be37-655624e5b8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.079092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6edbd-c80c-4ceb-be37-655624e5b8fc admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.086726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 887/1802] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:28.087906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e093fad-7e63-43e8-bb22-812bc8969f23 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.098616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e093fad-7e63-43e8-bb22-812bc8969f23 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.101933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 916/1803] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:28.103735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6edbd-c80c-4ceb-be37-655624e5b8fc admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.104212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab266d-9e77-4451-b740-61cb6cfb96ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.105259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab266d-9e77-4451-b740-61cb6cfb96ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.105544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab266d-9e77-4451-b740-61cb6cfb96ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.105818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab266d-9e77-4451-b740-61cb6cfb96ad admin admin] PATH_INFO: `/v3/projects/2a646ae3faff4b488c14d11c3097a5e0/users/0d2ed11084df45b6bf338999d63951b4/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.120816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6edbd-c80c-4ceb-be37-655624e5b8fc admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.130386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab266d-9e77-4451-b740-61cb6cfb96ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a646ae3faff4b488c14d11c3097a5e0, user_id=0d2ed11084df45b6bf338999d63951b4, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.133250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab266d-9e77-4451-b740-61cb6cfb96ad admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.135297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b083a-54d8-43ca-a11e-44b23ffc73ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.136390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b083a-54d8-43ca-a11e-44b23ffc73ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.136676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b083a-54d8-43ca-a11e-44b23ffc73ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.136948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b083a-54d8-43ca-a11e-44b23ffc73ec admin admin] PATH_INFO: `/v3/projects/701b1e56f6734c1396748b4bd81303be/users/9f0214dd79cb427cb881d6372cbe5742/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.143480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b083a-54d8-43ca-a11e-44b23ffc73ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=701b1e56f6734c1396748b4bd81303be, user_id=9f0214dd79cb427cb881d6372cbe5742, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.151201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b083a-54d8-43ca-a11e-44b23ffc73ec admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.161115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 888/1804] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:28 2022] PUT /identity/v3/projects/2a646ae3faff4b488c14d11c3097a5e0/users/0d2ed11084df45b6bf338999d63951b4/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:28.172876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036bbe-6ce1-45be-b3d2-edb8dff8c054 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.173187 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036bbe-6ce1-45be-b3d2-edb8dff8c054 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.173545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a036bbe-6ce1-45be-b3d2-edb8dff8c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.185824 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 917/1805] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:28 2022] PUT /identity/v3/projects/701b1e56f6734c1396748b4bd81303be/users/9f0214dd79cb427cb881d6372cbe5742/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:28.187955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c860-27b2-4947-b944-7a2b2762dd0a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.188242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c860-27b2-4947-b944-7a2b2762dd0a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.188939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c860-27b2-4947-b944-7a2b2762dd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.225505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1a036bbe-6ce1-45be-b3d2-edb8dff8c054 None None] MFA Rules not processed for user `0d2ed11084df45b6bf338999d63951b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:28.226875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1a036bbe-6ce1-45be-b3d2-edb8dff8c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:28.262446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7d53c860-27b2-4947-b944-7a2b2762dd0a None None] MFA Rules not processed for user `9f0214dd79cb427cb881d6372cbe5742`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:28.263427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7d53c860-27b2-4947-b944-7a2b2762dd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:28.415554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 889/1806] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:28.425620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 918/1807] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:28.427658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a036bbe-6ce1-45be-b3d2-edb8dff8c054 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.442034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53c860-27b2-4947-b944-7a2b2762dd0a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.443576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7d53c860-27b2-4947-b944-7a2b2762dd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:28.583535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53c860-27b2-4947-b944-7a2b2762dd0a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.591290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a036bbe-6ce1-45be-b3d2-edb8dff8c054 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.594262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.596775 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.597576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.598756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.605543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651fb73-9645-46b8-a2e8-946b07332fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.606905 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651fb73-9645-46b8-a2e8-946b07332fce admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.607421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651fb73-9645-46b8-a2e8-946b07332fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.607893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651fb73-9645-46b8-a2e8-946b07332fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.608795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651fb73-9645-46b8-a2e8-946b07332fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.611456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651fb73-9645-46b8-a2e8-946b07332fce admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.615290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:28.650272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 890/1808] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:28 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:28.651545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651fb73-9645-46b8-a2e8-946b07332fce admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.700849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.703384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.720846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 919/1809] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:28.722009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.723863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:28.742288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106f24f-5061-41cb-98cd-40fc995fd19e service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.750616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651fb73-9645-46b8-a2e8-946b07332fce admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.754242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.757544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e46b5-a97d-4ff4-82dc-0c3809b4e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.758402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e46b5-a97d-4ff4-82dc-0c3809b4e033 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.758531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.758623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e46b5-a97d-4ff4-82dc-0c3809b4e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.758868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e46b5-a97d-4ff4-82dc-0c3809b4e033 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.758996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.759458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] PATH_INFO: `/v3/projects/9594d45e83a64f2b8d7a50a9ae494974` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.759804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e46b5-a97d-4ff4-82dc-0c3809b4e033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.762519 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e46b5-a97d-4ff4-82dc-0c3809b4e033 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.763143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9594d45e83a64f2b8d7a50a9ae494974)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.767815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.788771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 891/1810] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:28 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:28.793704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e46b5-a97d-4ff4-82dc-0c3809b4e033 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.810381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e46b5-a97d-4ff4-82dc-0c3809b4e033 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.825220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4385698-5d77-46ef-a777-7fdaedb8226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:28.825905 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385698-5d77-46ef-a777-7fdaedb8226d admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:28.826200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385698-5d77-46ef-a777-7fdaedb8226d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:28.826515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385698-5d77-46ef-a777-7fdaedb8226d admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:28.828038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4385698-5d77-46ef-a777-7fdaedb8226d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:28.829724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4385698-5d77-46ef-a777-7fdaedb8226d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:28.856266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 892/1811] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:28.857344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4385698-5d77-46ef-a777-7fdaedb8226d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:28.872423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9594d45e83a64f2b8d7a50a9ae494974', 'request_id': 'req-bdd281af-913b-4ca1-b13f-fa73f038b1cf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:28.882655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4385698-5d77-46ef-a777-7fdaedb8226d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:28.938788 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9594d45e83a64f2b8d7a50a9ae494974', 'request_id': 'req-bdd281af-913b-4ca1-b13f-fa73f038b1cf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:28.949006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9594d45e83a64f2b8d7a50a9ae494974', 'request_id': 'req-bdd281af-913b-4ca1-b13f-fa73f038b1cf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:29.003805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.005025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.005620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.005906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] PATH_INFO: `/v3/projects/92fa8a1bf81040a587d844adb2fec446/users/648ddac924f24806ad3ac5db2e6dcca4/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.022315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] The token cache is being invalidate because project 9594d45e83a64f2b8d7a50a9ae494974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:29.022895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:29.024516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd281af-913b-4ca1-b13f-fa73f038b1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:29.027550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 920/1812] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:28 2022] DELETE /identity/v3/projects/9594d45e83a64f2b8d7a50a9ae494974 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:29.034212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff6ff-6ad2-4cfc-95b7-40ac9a7e00c6 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.034573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92fa8a1bf81040a587d844adb2fec446, user_id=648ddac924f24806ad3ac5db2e6dcca4, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:29.035119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff6ff-6ad2-4cfc-95b7-40ac9a7e00c6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.035119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff6ff-6ad2-4cfc-95b7-40ac9a7e00c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.041536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:29.068535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-490ff6ff-6ad2-4cfc-95b7-40ac9a7e00c6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:29.070372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-490ff6ff-6ad2-4cfc-95b7-40ac9a7e00c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:29.082837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 893/1813] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:28 2022] PUT /identity/v3/projects/92fa8a1bf81040a587d844adb2fec446/users/648ddac924f24806ad3ac5db2e6dcca4/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:29.087831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.096340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:29.150131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 921/1814] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:29.159648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d24e8-0f20-42ca-b3f4-fccdc49f42d6 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.160021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d24e8-0f20-42ca-b3f4-fccdc49f42d6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.160308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d24e8-0f20-42ca-b3f4-fccdc49f42d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.207504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5e8d24e8-0f20-42ca-b3f4-fccdc49f42d6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:29.210695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5e8d24e8-0f20-42ca-b3f4-fccdc49f42d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:29.223630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 922/1815] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:29.227722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d24e8-0f20-42ca-b3f4-fccdc49f42d6 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.244635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d24e8-0f20-42ca-b3f4-fccdc49f42d6 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:29.251296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.251296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.251296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.251670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.252292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:29.263155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:29.263155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:29.274677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 923/1816] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:45:29.278619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.292967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d83a2-e7c2-46b7-9d6d-e29cfa4abc60 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:29.298815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dd74c-dc6f-448d-806d-b29a6d725db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.299717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd74c-dc6f-448d-806d-b29a6d725db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.300632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd74c-dc6f-448d-806d-b29a6d725db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.301058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd74c-dc6f-448d-806d-b29a6d725db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.301895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dd74c-dc6f-448d-806d-b29a6d725db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:29.303472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeac6ec-2422-4d9e-b10d-9adc3410293d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:29.304651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9dd74c-dc6f-448d-806d-b29a6d725db1 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:29.326323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83188a70-1a8d-4c09-a47e-dd1ce5bf3216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.327287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188a70-1a8d-4c09-a47e-dd1ce5bf3216 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.327646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188a70-1a8d-4c09-a47e-dd1ce5bf3216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.332666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188a70-1a8d-4c09-a47e-dd1ce5bf3216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.334288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83188a70-1a8d-4c09-a47e-dd1ce5bf3216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:29.339895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83188a70-1a8d-4c09-a47e-dd1ce5bf3216 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:29.349903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 924/1817] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:29 2022] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:29.357077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dd74c-dc6f-448d-806d-b29a6d725db1 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.364689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 894/1818] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:29.370225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83188a70-1a8d-4c09-a47e-dd1ce5bf3216 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.409167 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83188a70-1a8d-4c09-a47e-dd1ce5bf3216 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:29.572297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dd74c-dc6f-448d-806d-b29a6d725db1 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:29.580108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeb414-4c87-421c-9802-283a0115bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.581594 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeb414-4c87-421c-9802-283a0115bd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.582287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeb414-4c87-421c-9802-283a0115bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.583280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeb414-4c87-421c-9802-283a0115bd7f admin admin] PATH_INFO: `/v3/projects/92fa8a1bf81040a587d844adb2fec446/users/648ddac924f24806ad3ac5db2e6dcca4/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.583385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feac9e-f4e3-4127-b515-92341cff6dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.584225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feac9e-f4e3-4127-b515-92341cff6dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.587613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feac9e-f4e3-4127-b515-92341cff6dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.587933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feac9e-f4e3-4127-b515-92341cff6dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.588534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeb414-4c87-421c-9802-283a0115bd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92fa8a1bf81040a587d844adb2fec446, user_id=648ddac924f24806ad3ac5db2e6dcca4, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:29.588648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feac9e-f4e3-4127-b515-92341cff6dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:29.594758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeb414-4c87-421c-9802-283a0115bd7f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:29.602195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feac9e-f4e3-4127-b515-92341cff6dc4 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:29.630352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 895/1819] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:29 2022] PUT /identity/v3/projects/92fa8a1bf81040a587d844adb2fec446/users/648ddac924f24806ad3ac5db2e6dcca4/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:29.641125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c20c1e-4427-4d8d-b5aa-f3c765dec768 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.641518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c20c1e-4427-4d8d-b5aa-f3c765dec768 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.642564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c20c1e-4427-4d8d-b5aa-f3c765dec768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.656960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 925/1820] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:29 2022] POST /identity/v3/users => generated 282 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:29.657892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feac9e-f4e3-4127-b515-92341cff6dc4 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.685490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feac9e-f4e3-4127-b515-92341cff6dc4 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:29.707363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-47c20c1e-4427-4d8d-b5aa-f3c765dec768 None None] MFA Rules not processed for user `648ddac924f24806ad3ac5db2e6dcca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:29.709225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-47c20c1e-4427-4d8d-b5aa-f3c765dec768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:29.827124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396e96a-d931-4a35-abb6-efe735b4a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.827869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396e96a-d931-4a35-abb6-efe735b4a0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.828160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396e96a-d931-4a35-abb6-efe735b4a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.828448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396e96a-d931-4a35-abb6-efe735b4a0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.829191 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396e96a-d931-4a35-abb6-efe735b4a0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:29.843040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396e96a-d931-4a35-abb6-efe735b4a0ac admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:29.863613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 926/1821] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:29.867627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396e96a-d931-4a35-abb6-efe735b4a0ac admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.887364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396e96a-d931-4a35-abb6-efe735b4a0ac admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:29.898888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.901908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.902207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.902556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.905703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:29.910924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 896/1822] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:29.911159 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:29.933445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 927/1823] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:29.937865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c20c1e-4427-4d8d-b5aa-f3c765dec768 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.949871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c20c1e-4427-4d8d-b5aa-f3c765dec768 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:29.974864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e440da-b1e0-4719-8661-0353d327573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:29.979398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e440da-b1e0-4719-8661-0353d327573c admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:29.980029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e440da-b1e0-4719-8661-0353d327573c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:29.980420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e440da-b1e0-4719-8661-0353d327573c admin admin] PATH_INFO: `/v3/projects/1abd92ffc95e4e6999a0c8b7468ca5f7/users/d9e9cd009b844e6b9b9e15de785425b0/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:29.989216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:29.991007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:30.022159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e440da-b1e0-4719-8661-0353d327573c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abd92ffc95e4e6999a0c8b7468ca5f7, user_id=d9e9cd009b844e6b9b9e15de785425b0, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.024962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e440da-b1e0-4719-8661-0353d327573c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.073385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 897/1824] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:29 2022] PUT /identity/v3/projects/1abd92ffc95e4e6999a0c8b7468ca5f7/users/d9e9cd009b844e6b9b9e15de785425b0/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:30.075346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d18d-b452-4279-896b-e232d7c2525b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.075700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d18d-b452-4279-896b-e232d7c2525b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.076044 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d18d-b452-4279-896b-e232d7c2525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.088215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93855eb-c85a-4b70-99e6-2203a3efb070 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.108891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-7294d18d-b452-4279-896b-e232d7c2525b None None] MFA Rules not processed for user `d9e9cd009b844e6b9b9e15de785425b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:30.110318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7294d18d-b452-4279-896b-e232d7c2525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:30.146209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35dd75-e168-479b-a37f-43d7ef477f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.146863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dd75-e168-479b-a37f-43d7ef477f1e service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.147175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dd75-e168-479b-a37f-43d7ef477f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.147454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dd75-e168-479b-a37f-43d7ef477f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.183968 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 898/1825] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:30.188674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d18d-b452-4279-896b-e232d7c2525b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.221748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35dd75-e168-479b-a37f-43d7ef477f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.223716 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35dd75-e168-479b-a37f-43d7ef477f1e service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.235524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 928/1826] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:30.237032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4099b-e49d-4c07-90f3-d34f82a9a051 None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.237390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4099b-e49d-4c07-90f3-d34f82a9a051 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.237733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4099b-e49d-4c07-90f3-d34f82a9a051 None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.239281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 929/1827] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:45:30.259982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336bbf-4132-45e5-93e9-b35abcbd133e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.260355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336bbf-4132-45e5-93e9-b35abcbd133e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.260746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336bbf-4132-45e5-93e9-b35abcbd133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.286004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d18d-b452-4279-896b-e232d7c2525b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.291351 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-48336bbf-4132-45e5-93e9-b35abcbd133e None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:30.291772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846592-672d-402d-a413-86a03e83da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.292313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846592-672d-402d-a413-86a03e83da8a admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.292606 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846592-672d-402d-a413-86a03e83da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.292994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846592-672d-402d-a413-86a03e83da8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.293114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-48336bbf-4132-45e5-93e9-b35abcbd133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:30.293758 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67846592-672d-402d-a413-86a03e83da8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.296217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67846592-672d-402d-a413-86a03e83da8a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.339671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 899/1828] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:30 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:30.352755 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846592-672d-402d-a413-86a03e83da8a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.386384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 930/1829] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:45:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:30.387307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336bbf-4132-45e5-93e9-b35abcbd133e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.396859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336bbf-4132-45e5-93e9-b35abcbd133e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.446387 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846592-672d-402d-a413-86a03e83da8a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.451708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.452387 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.452675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.453529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.454253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.456205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.459530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.460287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.460664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.461033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.462950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:30.486845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 900/1830] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:30 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:30.487806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.489796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:30.546254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.548678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.569749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 931/1831] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:30.571652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.589323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcae96d-360b-473a-9f7e-f48599373cd1 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.600844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519905bb-d069-4300-8402-9d3f5cf42e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.601523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519905bb-d069-4300-8402-9d3f5cf42e0b service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.601809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519905bb-d069-4300-8402-9d3f5cf42e0b service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.602086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519905bb-d069-4300-8402-9d3f5cf42e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.612287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3394eb1-b092-4236-aa4a-e0c44a39df35 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.615877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519905bb-d069-4300-8402-9d3f5cf42e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.617778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519905bb-d069-4300-8402-9d3f5cf42e0b service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.632242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 901/1832] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:30.642932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b9c89-dc84-4f12-a550-d666e8230cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.643650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9c89-dc84-4f12-a550-d666e8230cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.643941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9c89-dc84-4f12-a550-d666e8230cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.644233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9c89-dc84-4f12-a550-d666e8230cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.644930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b9c89-dc84-4f12-a550-d666e8230cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.646521 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b9c89-dc84-4f12-a550-d666e8230cc6 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.665184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 932/1833] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:30.669478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519905bb-d069-4300-8402-9d3f5cf42e0b service nova] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.683238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519905bb-d069-4300-8402-9d3f5cf42e0b service nova] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.688675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84569c9f-405f-414c-8078-7469708b6d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.689623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84569c9f-405f-414c-8078-7469708b6d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.689968 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84569c9f-405f-414c-8078-7469708b6d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.690302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84569c9f-405f-414c-8078-7469708b6d12 admin admin] PATH_INFO: `/v3/projects/b189074db5f04a40a0858c35cc66e974/users/7173c673661546808d9648ce58f0a3c0/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.705452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84569c9f-405f-414c-8078-7469708b6d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b189074db5f04a40a0858c35cc66e974, user_id=7173c673661546808d9648ce58f0a3c0, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.708388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84569c9f-405f-414c-8078-7469708b6d12 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.725224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 902/1834] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:30 2022] PUT /identity/v3/projects/b189074db5f04a40a0858c35cc66e974/users/7173c673661546808d9648ce58f0a3c0/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:30.728961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b9c89-dc84-4f12-a550-d666e8230cc6 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.740939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b9c89-dc84-4f12-a550-d666e8230cc6 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.811169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024f956-2205-4b91-8946-8e299b502e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.811829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024f956-2205-4b91-8946-8e299b502e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.812125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024f956-2205-4b91-8946-8e299b502e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.812411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024f956-2205-4b91-8946-8e299b502e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.813158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024f956-2205-4b91-8946-8e299b502e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.814732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024f956-2205-4b91-8946-8e299b502e98 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.827538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 933/1835] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:30.829201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84569c9f-405f-414c-8078-7469708b6d12 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.839469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84569c9f-405f-414c-8078-7469708b6d12 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:30.844502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:30.845385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.845664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.845934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] PATH_INFO: `/v3/projects/b189074db5f04a40a0858c35cc66e974/users/7173c673661546808d9648ce58f0a3c0/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.847977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b189074db5f04a40a0858c35cc66e974, user_id=7173c673661546808d9648ce58f0a3c0, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:30.852053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:30.864237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 903/1836] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:30 2022] PUT /identity/v3/projects/b189074db5f04a40a0858c35cc66e974/users/7173c673661546808d9648ce58f0a3c0/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:30.879752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207e6b1-f36b-4b7c-a035-7f67d4cfa1f1 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:30.880130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207e6b1-f36b-4b7c-a035-7f67d4cfa1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:30.880479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207e6b1-f36b-4b7c-a035-7f67d4cfa1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:30.908383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4207e6b1-f36b-4b7c-a035-7f67d4cfa1f1 None None] MFA Rules not processed for user `7173c673661546808d9648ce58f0a3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:30.909593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4207e6b1-f36b-4b7c-a035-7f67d4cfa1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:30.977117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 934/1837] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:30.988610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:30.990312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:31.051239 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f96d85-6e75-4653-a3c4-a3d8bbff7331 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:31.054747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e48f47-30c3-4504-bd23-1838406894f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:31.055419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e48f47-30c3-4504-bd23-1838406894f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:31.055700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e48f47-30c3-4504-bd23-1838406894f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:31.056000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e48f47-30c3-4504-bd23-1838406894f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:31.065430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e48f47-30c3-4504-bd23-1838406894f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:31.066841 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e48f47-30c3-4504-bd23-1838406894f9 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:31.076057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 904/1838] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:31.471646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207e6b1-f36b-4b7c-a035-7f67d4cfa1f1 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:31.532056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207e6b1-f36b-4b7c-a035-7f67d4cfa1f1 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:31.536484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:31.537352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:31.537635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:31.537910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] PATH_INFO: `/v3/users/d9e9cd009b844e6b9b9e15de785425b0` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:31.539109 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e9cd009b844e6b9b9e15de785425b0)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:31.541019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:31.584851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e9cd009b844e6b9b9e15de785425b0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:31.591222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e9cd009b844e6b9b9e15de785425b0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:31.598739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e9cd009b844e6b9b9e15de785425b0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:31.599382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e9cd009b844e6b9b9e15de785425b0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:31.611244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e9cd009b844e6b9b9e15de785425b0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:31.617006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 935/1839] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:31 2022] DELETE /identity/v3/users/d9e9cd009b844e6b9b9e15de785425b0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:31.621492 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8b55-b1f8-4d7b-b903-fbb228ed9510 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:31.621802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8b55-b1f8-4d7b-b903-fbb228ed9510 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:31.622062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8b55-b1f8-4d7b-b903-fbb228ed9510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:31.641918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-039e8b55-b1f8-4d7b-b903-fbb228ed9510 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:31.643140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-039e8b55-b1f8-4d7b-b903-fbb228ed9510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:31.701148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 905/1840] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:31.710730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:31.712311 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:31.770274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa533fc-b33b-43a3-8f41-78ababb09d12 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:31.775178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf7b1-21ef-45e7-b90d-affbbe8227e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:31.775832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf7b1-21ef-45e7-b90d-affbbe8227e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:31.776117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf7b1-21ef-45e7-b90d-affbbe8227e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:31.776392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bf7b1-21ef-45e7-b90d-affbbe8227e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:31.787132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bf7b1-21ef-45e7-b90d-affbbe8227e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:31.788659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bf7b1-21ef-45e7-b90d-affbbe8227e8 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:31.799165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 936/1841] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:32.064904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e8b55-b1f8-4d7b-b903-fbb228ed9510 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:32.066337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-039e8b55-b1f8-4d7b-b903-fbb228ed9510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:32.078090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e8b55-b1f8-4d7b-b903-fbb228ed9510 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:32.083995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:32.084858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:32.085299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:32.085750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] PATH_INFO: `/v3/projects/1abd92ffc95e4e6999a0c8b7468ca5f7` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:32.087124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abd92ffc95e4e6999a0c8b7468ca5f7)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:32.090007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:32.147874 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abd92ffc95e4e6999a0c8b7468ca5f7', 'request_id': 'req-775b0a94-60f4-4722-aa64-b37cd5a9ca62'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.155227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abd92ffc95e4e6999a0c8b7468ca5f7', 'request_id': 'req-775b0a94-60f4-4722-aa64-b37cd5a9ca62'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.161141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abd92ffc95e4e6999a0c8b7468ca5f7', 'request_id': 'req-775b0a94-60f4-4722-aa64-b37cd5a9ca62'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.171796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] The token cache is being invalidate because project 1abd92ffc95e4e6999a0c8b7468ca5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:32.172084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.172699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.174221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 906/1842] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:32 2022] DELETE /identity/v3/projects/1abd92ffc95e4e6999a0c8b7468ca5f7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:32.178333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf7b1-21ef-45e7-b90d-affbbe8227e8 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:32.187801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bf7b1-21ef-45e7-b90d-affbbe8227e8 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:32.241489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c748-af03-4449-a561-28651a602cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:32.242353 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c748-af03-4449-a561-28651a602cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:32.242631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c748-af03-4449-a561-28651a602cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:32.242903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c748-af03-4449-a561-28651a602cca admin admin] PATH_INFO: `/v3/users/7173c673661546808d9648ce58f0a3c0` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:32.244097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c748-af03-4449-a561-28651a602cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7173c673661546808d9648ce58f0a3c0)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:32.245987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c748-af03-4449-a561-28651a602cca admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:32.291201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c954c748-af03-4449-a561-28651a602cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7173c673661546808d9648ce58f0a3c0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.297845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c954c748-af03-4449-a561-28651a602cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7173c673661546808d9648ce58f0a3c0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.305277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c954c748-af03-4449-a561-28651a602cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7173c673661546808d9648ce58f0a3c0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.305935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c954c748-af03-4449-a561-28651a602cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7173c673661546808d9648ce58f0a3c0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.317425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c954c748-af03-4449-a561-28651a602cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7173c673661546808d9648ce58f0a3c0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.323201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 937/1843] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:32 2022] DELETE /identity/v3/users/7173c673661546808d9648ce58f0a3c0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:32.612805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:32.614425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:32.627573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b0a94-60f4-4722-aa64-b37cd5a9ca62 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:32.706837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:32.707734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:32.708012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:32.708284 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] PATH_INFO: `/v3/projects/b189074db5f04a40a0858c35cc66e974` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:32.709458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b189074db5f04a40a0858c35cc66e974)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:32.711413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:32.755045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b189074db5f04a40a0858c35cc66e974', 'request_id': 'req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.762082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b189074db5f04a40a0858c35cc66e974', 'request_id': 'req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.768007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b189074db5f04a40a0858c35cc66e974', 'request_id': 'req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.778472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] The token cache is being invalidate because project b189074db5f04a40a0858c35cc66e974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:32.778754 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.779407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7b0f6e53-4308-4338-90ab-82fd62e4b1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:32.780994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 907/1844] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:32 2022] DELETE /identity/v3/projects/b189074db5f04a40a0858c35cc66e974 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:32.785791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745983f-1a49-400d-a175-73942ea932d9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:32.786241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745983f-1a49-400d-a175-73942ea932d9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:32.786369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745983f-1a49-400d-a175-73942ea932d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:32.805093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d745983f-1a49-400d-a175-73942ea932d9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:32.806289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d745983f-1a49-400d-a175-73942ea932d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:32.895965 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 938/1845] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:32.897633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada5cb-120c-4b53-8132-7c78358098bb None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:32.897922 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada5cb-120c-4b53-8132-7c78358098bb None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:32.898256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada5cb-120c-4b53-8132-7c78358098bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:32.922394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-9eada5cb-120c-4b53-8132-7c78358098bb None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:32.923555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9eada5cb-120c-4b53-8132-7c78358098bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:32.936615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 908/1846] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:32.938429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745983f-1a49-400d-a175-73942ea932d9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:32.950101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745983f-1a49-400d-a175-73942ea932d9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:32.955964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:32.956755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:32.957105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:32.957586 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:32.958245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:32.958699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:32.960420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:32.978519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 939/1847] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:32.979497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada5cb-120c-4b53-8132-7c78358098bb None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:32.989129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada5cb-120c-4b53-8132-7c78358098bb None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:32.993854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224149-74b5-4ad4-9804-1812edeadda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:32.994588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224149-74b5-4ad4-9804-1812edeadda4 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:32.994791 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224149-74b5-4ad4-9804-1812edeadda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:32.995100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224149-74b5-4ad4-9804-1812edeadda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:32.995788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224149-74b5-4ad4-9804-1812edeadda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:32.997763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224149-74b5-4ad4-9804-1812edeadda4 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.024604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 909/1848] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:32 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:33.030035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.045533 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5c0a-1b46-423e-bb33-cda39ee36c84 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.134321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffeb1c-25ca-4783-8584-a95e3428d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.135007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffeb1c-25ca-4783-8584-a95e3428d899 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.135296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffeb1c-25ca-4783-8584-a95e3428d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.135571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffeb1c-25ca-4783-8584-a95e3428d899 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.136472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffeb1c-25ca-4783-8584-a95e3428d899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.138780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffeb1c-25ca-4783-8584-a95e3428d899 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.187736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224149-74b5-4ad4-9804-1812edeadda4 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.188822 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 940/1849] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:33 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:33.210874 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224149-74b5-4ad4-9804-1812edeadda4 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.216545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fbca8-3460-4c71-9346-7a7375606a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.217719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fbca8-3460-4c71-9346-7a7375606a16 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.219154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fbca8-3460-4c71-9346-7a7375606a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.219657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fbca8-3460-4c71-9346-7a7375606a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.220650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fbca8-3460-4c71-9346-7a7375606a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.222662 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fbca8-3460-4c71-9346-7a7375606a16 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.240725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 910/1850] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:33.244886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffeb1c-25ca-4783-8584-a95e3428d899 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.266169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffeb1c-25ca-4783-8584-a95e3428d899 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.270798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223cc7-db43-4087-9103-21cc9fc65e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.271492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223cc7-db43-4087-9103-21cc9fc65e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.271800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223cc7-db43-4087-9103-21cc9fc65e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.272078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223cc7-db43-4087-9103-21cc9fc65e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.272828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223cc7-db43-4087-9103-21cc9fc65e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.274409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223cc7-db43-4087-9103-21cc9fc65e07 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.290238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 941/1851] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:33.291552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fbca8-3460-4c71-9346-7a7375606a16 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.302248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fbca8-3460-4c71-9346-7a7375606a16 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.306766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a744b13-21b1-4a38-858d-d58b3677f7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.307681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a744b13-21b1-4a38-858d-d58b3677f7c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.307962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a744b13-21b1-4a38-858d-d58b3677f7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.308234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a744b13-21b1-4a38-858d-d58b3677f7c6 admin admin] PATH_INFO: `/v3/projects/b734d36745474c4ea6fb80d4b8984d21/users/1875e3460ee34b85a39cb9d5b58557d7/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.324615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a744b13-21b1-4a38-858d-d58b3677f7c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b734d36745474c4ea6fb80d4b8984d21, user_id=1875e3460ee34b85a39cb9d5b58557d7, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.327411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a744b13-21b1-4a38-858d-d58b3677f7c6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.341193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 911/1852] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:33 2022] PUT /identity/v3/projects/b734d36745474c4ea6fb80d4b8984d21/users/1875e3460ee34b85a39cb9d5b58557d7/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:33.351734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4fb9e-d8f5-4b27-abd5-e066ae6d97b3 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.352087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4fb9e-d8f5-4b27-abd5-e066ae6d97b3 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.352356 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4fb9e-d8f5-4b27-abd5-e066ae6d97b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.378291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-edb4fb9e-d8f5-4b27-abd5-e066ae6d97b3 None None] MFA Rules not processed for user `1875e3460ee34b85a39cb9d5b58557d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:33.379523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-edb4fb9e-d8f5-4b27-abd5-e066ae6d97b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:33.441017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 942/1853] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:33.445405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a744b13-21b1-4a38-858d-d58b3677f7c6 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.502835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a744b13-21b1-4a38-858d-d58b3677f7c6 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.507633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbec6f5-d33a-4433-92e3-460c0bc3307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.508324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec6f5-d33a-4433-92e3-460c0bc3307f admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.508610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec6f5-d33a-4433-92e3-460c0bc3307f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.508886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec6f5-d33a-4433-92e3-460c0bc3307f admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.509608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbec6f5-d33a-4433-92e3-460c0bc3307f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.511622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbec6f5-d33a-4433-92e3-460c0bc3307f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.537456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 912/1854] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:33 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:33.541486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4fb9e-d8f5-4b27-abd5-e066ae6d97b3 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.552188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4fb9e-d8f5-4b27-abd5-e066ae6d97b3 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.612252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964db6c-7ad7-4249-baf8-35a1d6c0f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.613280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964db6c-7ad7-4249-baf8-35a1d6c0f6ab admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.613792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964db6c-7ad7-4249-baf8-35a1d6c0f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.614305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964db6c-7ad7-4249-baf8-35a1d6c0f6ab admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.615050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964db6c-7ad7-4249-baf8-35a1d6c0f6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.617601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964db6c-7ad7-4249-baf8-35a1d6c0f6ab admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.647038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 943/1855] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:33 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:33.649100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbec6f5-d33a-4433-92e3-460c0bc3307f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.660394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbec6f5-d33a-4433-92e3-460c0bc3307f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.666354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a42f2b-4783-4434-aa6c-6e0c0d7f21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.667538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42f2b-4783-4434-aa6c-6e0c0d7f21e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.667826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42f2b-4783-4434-aa6c-6e0c0d7f21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.668103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42f2b-4783-4434-aa6c-6e0c0d7f21e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.668860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a42f2b-4783-4434-aa6c-6e0c0d7f21e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.670774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a42f2b-4783-4434-aa6c-6e0c0d7f21e0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.684997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 913/1856] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:33.689816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964db6c-7ad7-4249-baf8-35a1d6c0f6ab admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.700053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964db6c-7ad7-4249-baf8-35a1d6c0f6ab admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.704821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537aad4-04a0-4c2b-9772-c6a71d1c8316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.706555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537aad4-04a0-4c2b-9772-c6a71d1c8316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.706555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537aad4-04a0-4c2b-9772-c6a71d1c8316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.706555 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537aad4-04a0-4c2b-9772-c6a71d1c8316 admin admin] PATH_INFO: `/v3/projects/71cb467f66354c1cb77b13e6516e8430/users/6b348c3f514443e08caa3df0c8ff8ede/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.722283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537aad4-04a0-4c2b-9772-c6a71d1c8316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cb467f66354c1cb77b13e6516e8430, user_id=6b348c3f514443e08caa3df0c8ff8ede, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.724959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537aad4-04a0-4c2b-9772-c6a71d1c8316 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.739797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 944/1857] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:33 2022] PUT /identity/v3/projects/71cb467f66354c1cb77b13e6516e8430/users/6b348c3f514443e08caa3df0c8ff8ede/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:33.744806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a42f2b-4783-4434-aa6c-6e0c0d7f21e0 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.757458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a42f2b-4783-4434-aa6c-6e0c0d7f21e0 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.813514 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53474-187c-4d7e-96c7-69a38d395874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.814355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53474-187c-4d7e-96c7-69a38d395874 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.814635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53474-187c-4d7e-96c7-69a38d395874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.814911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53474-187c-4d7e-96c7-69a38d395874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.815674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca53474-187c-4d7e-96c7-69a38d395874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.817350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca53474-187c-4d7e-96c7-69a38d395874 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.827489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 914/1858] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:33.831826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537aad4-04a0-4c2b-9772-c6a71d1c8316 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.841939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537aad4-04a0-4c2b-9772-c6a71d1c8316 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:33.846577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:33.847500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.847785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.848062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] PATH_INFO: `/v3/projects/71cb467f66354c1cb77b13e6516e8430/users/6b348c3f514443e08caa3df0c8ff8ede/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.850233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cb467f66354c1cb77b13e6516e8430, user_id=6b348c3f514443e08caa3df0c8ff8ede, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:33.852905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:33.863393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 945/1859] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:33 2022] PUT /identity/v3/projects/71cb467f66354c1cb77b13e6516e8430/users/6b348c3f514443e08caa3df0c8ff8ede/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:33.874211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f89ce3-22db-49d4-88c5-3c91fd6b32d5 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:33.874505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f89ce3-22db-49d4-88c5-3c91fd6b32d5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:33.875370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f89ce3-22db-49d4-88c5-3c91fd6b32d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:33.901243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-25f89ce3-22db-49d4-88c5-3c91fd6b32d5 None None] MFA Rules not processed for user `6b348c3f514443e08caa3df0c8ff8ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:33.902454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-25f89ce3-22db-49d4-88c5-3c91fd6b32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:33.969582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 915/1860] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:33.981005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:33.982726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:34.043663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fca0-6597-40a6-b532-14a5ff36eab8 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:34.048128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b0070-6214-459b-aac0-bfe8249ed96a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:34.048768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b0070-6214-459b-aac0-bfe8249ed96a service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:34.049046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b0070-6214-459b-aac0-bfe8249ed96a service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:34.049319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b0070-6214-459b-aac0-bfe8249ed96a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:34.058748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b0070-6214-459b-aac0-bfe8249ed96a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:34.060201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b0070-6214-459b-aac0-bfe8249ed96a service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:34.070158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 946/1861] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:34.133226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f89ce3-22db-49d4-88c5-3c91fd6b32d5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:34.193858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f89ce3-22db-49d4-88c5-3c91fd6b32d5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:34.198383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:34.199274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:34.199561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:34.199824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] PATH_INFO: `/v3/users/1875e3460ee34b85a39cb9d5b58557d7` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:34.201033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1875e3460ee34b85a39cb9d5b58557d7)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:34.202951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:34.246338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1875e3460ee34b85a39cb9d5b58557d7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.253712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1875e3460ee34b85a39cb9d5b58557d7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.262866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1875e3460ee34b85a39cb9d5b58557d7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.263522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1875e3460ee34b85a39cb9d5b58557d7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.275289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1875e3460ee34b85a39cb9d5b58557d7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.281688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 916/1862] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:34 2022] DELETE /identity/v3/users/1875e3460ee34b85a39cb9d5b58557d7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:34.286151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48619-7e51-455d-972a-ecc762f076d4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:34.286439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48619-7e51-455d-972a-ecc762f076d4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:34.286714 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48619-7e51-455d-972a-ecc762f076d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:34.304312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d0f48619-7e51-455d-972a-ecc762f076d4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:34.305525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d0f48619-7e51-455d-972a-ecc762f076d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:34.367577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 947/1863] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:34.377117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:34.379233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:34.435882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289c97e-2e0b-4f01-b708-631d0b3f58f0 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:34.439664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a823f-9882-4d49-a429-2e70a4764972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:34.440314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a823f-9882-4d49-a429-2e70a4764972 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:34.440598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a823f-9882-4d49-a429-2e70a4764972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:34.440876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a823f-9882-4d49-a429-2e70a4764972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:34.450004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a823f-9882-4d49-a429-2e70a4764972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:34.451479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a823f-9882-4d49-a429-2e70a4764972 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:34.461340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 917/1864] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:34.759961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48619-7e51-455d-972a-ecc762f076d4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:34.761373 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d0f48619-7e51-455d-972a-ecc762f076d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:34.779480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48619-7e51-455d-972a-ecc762f076d4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:34.784455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:34.785359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:34.785669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:34.785847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] PATH_INFO: `/v3/projects/b734d36745474c4ea6fb80d4b8984d21` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:34.787065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b734d36745474c4ea6fb80d4b8984d21)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:34.788994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:34.834703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b734d36745474c4ea6fb80d4b8984d21', 'request_id': 'req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.842365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b734d36745474c4ea6fb80d4b8984d21', 'request_id': 'req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.847689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b734d36745474c4ea6fb80d4b8984d21', 'request_id': 'req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.863946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] The token cache is being invalidate because project b734d36745474c4ea6fb80d4b8984d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:34.864234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.864873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.866605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 948/1865] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:34 2022] DELETE /identity/v3/projects/b734d36745474c4ea6fb80d4b8984d21 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:34.870367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a823f-9882-4d49-a429-2e70a4764972 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:34.883659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a823f-9882-4d49-a429-2e70a4764972 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:34.935647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:34.936512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:34.936786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:34.937577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] PATH_INFO: `/v3/users/6b348c3f514443e08caa3df0c8ff8ede` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:34.938755 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b348c3f514443e08caa3df0c8ff8ede)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:34.940685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:34.987370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b348c3f514443e08caa3df0c8ff8ede'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:34.994086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b348c3f514443e08caa3df0c8ff8ede'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.002409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b348c3f514443e08caa3df0c8ff8ede'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.003126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b348c3f514443e08caa3df0c8ff8ede'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.015080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f53c4a3c-1853-4938-a5d8-93536eb553b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b348c3f514443e08caa3df0c8ff8ede'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.021494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 918/1866] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:34 2022] DELETE /identity/v3/users/6b348c3f514443e08caa3df0c8ff8ede => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:35.364226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:35.365761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:35.395891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbd7aa-6b34-4d14-9708-20c5d2a8beac admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:35.444339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:35.445204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.445488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.445766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] PATH_INFO: `/v3/projects/71cb467f66354c1cb77b13e6516e8430` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.446939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] RBAC: Authorizing `identity:delete_project(project_id=71cb467f66354c1cb77b13e6516e8430)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:35.448867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:35.494991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71cb467f66354c1cb77b13e6516e8430', 'request_id': 'req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.503252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71cb467f66354c1cb77b13e6516e8430', 'request_id': 'req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.508709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71cb467f66354c1cb77b13e6516e8430', 'request_id': 'req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.519506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] The token cache is being invalidate because project 71cb467f66354c1cb77b13e6516e8430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:35.519727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.520347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ecf8d2a6-c1bf-4d48-b3ee-247649bb46da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:35.522069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 949/1867] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:35 2022] DELETE /identity/v3/projects/71cb467f66354c1cb77b13e6516e8430 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:35.526777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ddcc-d96e-42b3-afe4-b03d93bb65cc None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.527316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ddcc-d96e-42b3-afe4-b03d93bb65cc None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.527400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ddcc-d96e-42b3-afe4-b03d93bb65cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.545926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-59f2ddcc-d96e-42b3-afe4-b03d93bb65cc None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:35.547762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-59f2ddcc-d96e-42b3-afe4-b03d93bb65cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:35.603999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 919/1868] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:35.612267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc297f-6c5e-4d91-8231-09f221d9801e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.612556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc297f-6c5e-4d91-8231-09f221d9801e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.612833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc297f-6c5e-4d91-8231-09f221d9801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.630871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d2dc297f-6c5e-4d91-8231-09f221d9801e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:35.632104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d2dc297f-6c5e-4d91-8231-09f221d9801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:35.639975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 950/1869] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:35.644202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ddcc-d96e-42b3-afe4-b03d93bb65cc None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:35.653497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ddcc-d96e-42b3-afe4-b03d93bb65cc None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:35.658661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:35.659327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.659611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.659885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.660611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:35.660914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:35.662502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:35.678066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 920/1870] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:35.679485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc297f-6c5e-4d91-8231-09f221d9801e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:35.688426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc297f-6c5e-4d91-8231-09f221d9801e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:35.693040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cb62-7ae8-4cca-bff7-4d4780784062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:35.693684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cb62-7ae8-4cca-bff7-4d4780784062 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.693960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cb62-7ae8-4cca-bff7-4d4780784062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.694231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cb62-7ae8-4cca-bff7-4d4780784062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.694919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620cb62-7ae8-4cca-bff7-4d4780784062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:35.696823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620cb62-7ae8-4cca-bff7-4d4780784062 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:35.722195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 951/1871] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:35 2022] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:35.726043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:35.736343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438a3ff-9b79-4e7a-81f4-3eeb27e6670a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:35.790141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df263-75f8-4226-bd50-79b0d0d8f4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:35.790742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df263-75f8-4226-bd50-79b0d0d8f4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.791064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df263-75f8-4226-bd50-79b0d0d8f4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.791351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df263-75f8-4226-bd50-79b0d0d8f4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.792033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df263-75f8-4226-bd50-79b0d0d8f4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:35.793943 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df263-75f8-4226-bd50-79b0d0d8f4a3 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:35.813151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 921/1872] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:35 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:35.817206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cb62-7ae8-4cca-bff7-4d4780784062 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:35.827078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cb62-7ae8-4cca-bff7-4d4780784062 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:35.831619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cda5-d641-42e0-b5d0-c3c164a4c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:35.832294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cda5-d641-42e0-b5d0-c3c164a4c37c admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.832575 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cda5-d641-42e0-b5d0-c3c164a4c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.832850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cda5-d641-42e0-b5d0-c3c164a4c37c admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.833568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354cda5-d641-42e0-b5d0-c3c164a4c37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:35.835174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354cda5-d641-42e0-b5d0-c3c164a4c37c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:35.845998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 952/1873] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:35.850041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df263-75f8-4226-bd50-79b0d0d8f4a3 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:35.860522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df263-75f8-4226-bd50-79b0d0d8f4a3 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:35.865126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa3d1-ded0-4a88-bd7d-5fa4d35e3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:35.865780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa3d1-ded0-4a88-bd7d-5fa4d35e3fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.866066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa3d1-ded0-4a88-bd7d-5fa4d35e3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.866347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa3d1-ded0-4a88-bd7d-5fa4d35e3fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.867107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa3d1-ded0-4a88-bd7d-5fa4d35e3fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:35.868695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa3d1-ded0-4a88-bd7d-5fa4d35e3fbc admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:35.878296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 922/1874] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:35.882674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cda5-d641-42e0-b5d0-c3c164a4c37c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:35.893176 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cda5-d641-42e0-b5d0-c3c164a4c37c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:35.898116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e4ab5-0735-4e33-bc8d-e032789aff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:35.899234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e4ab5-0735-4e33-bc8d-e032789aff11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.899593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e4ab5-0735-4e33-bc8d-e032789aff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.899944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e4ab5-0735-4e33-bc8d-e032789aff11 admin admin] PATH_INFO: `/v3/projects/89e452cf721c4b2a8176d6364a7a9966/users/47aba572029047108b6827bf2db59f09/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.916962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e4ab5-0735-4e33-bc8d-e032789aff11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e452cf721c4b2a8176d6364a7a9966, user_id=47aba572029047108b6827bf2db59f09, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:35.919810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e4ab5-0735-4e33-bc8d-e032789aff11 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:35.933113 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 953/1875] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:35 2022] PUT /identity/v3/projects/89e452cf721c4b2a8176d6364a7a9966/users/47aba572029047108b6827bf2db59f09/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:35.943799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a629-fcc8-4fbe-9635-68a56dca975e None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:35.944089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a629-fcc8-4fbe-9635-68a56dca975e None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:35.944373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a629-fcc8-4fbe-9635-68a56dca975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:35.981778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-8ed2a629-fcc8-4fbe-9635-68a56dca975e None None] MFA Rules not processed for user `47aba572029047108b6827bf2db59f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:35.983231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8ed2a629-fcc8-4fbe-9635-68a56dca975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:36.061897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 923/1876] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:36.064931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e4ab5-0735-4e33-bc8d-e032789aff11 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.129382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e4ab5-0735-4e33-bc8d-e032789aff11 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.137753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045c50-06c2-4341-9fad-f24c12039b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.138419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045c50-06c2-4341-9fad-f24c12039b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.138705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045c50-06c2-4341-9fad-f24c12039b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.139008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045c50-06c2-4341-9fad-f24c12039b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.139701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3045c50-06c2-4341-9fad-f24c12039b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.142134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3045c50-06c2-4341-9fad-f24c12039b6b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.170019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 954/1877] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:36 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:36.173940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2a629-fcc8-4fbe-9635-68a56dca975e None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.184835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2a629-fcc8-4fbe-9635-68a56dca975e None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.238522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debab69-f00f-4c3b-867f-c65e723e65c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.239257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debab69-f00f-4c3b-867f-c65e723e65c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.239550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debab69-f00f-4c3b-867f-c65e723e65c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.239837 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debab69-f00f-4c3b-867f-c65e723e65c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.240535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debab69-f00f-4c3b-867f-c65e723e65c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.242453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debab69-f00f-4c3b-867f-c65e723e65c5 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.263631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 924/1878] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:36 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:36.268229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045c50-06c2-4341-9fad-f24c12039b6b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.278323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045c50-06c2-4341-9fad-f24c12039b6b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.283035 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c8d6a-0d62-4324-9858-a7251e43ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.283776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c8d6a-0d62-4324-9858-a7251e43ba8b admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.284081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c8d6a-0d62-4324-9858-a7251e43ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.284357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c8d6a-0d62-4324-9858-a7251e43ba8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.285080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c8d6a-0d62-4324-9858-a7251e43ba8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.286650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c8d6a-0d62-4324-9858-a7251e43ba8b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.297050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 955/1879] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:36.301108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debab69-f00f-4c3b-867f-c65e723e65c5 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.310847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debab69-f00f-4c3b-867f-c65e723e65c5 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.315889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab793db-8b00-45a5-a72a-eab9bf01b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.316766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab793db-8b00-45a5-a72a-eab9bf01b5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.317042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab793db-8b00-45a5-a72a-eab9bf01b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.317312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab793db-8b00-45a5-a72a-eab9bf01b5ca admin admin] PATH_INFO: `/v3/projects/d29726497e45426f8cac3af336f26fd9/users/8a91f740def14572bcedb25ff1770a42/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.333106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab793db-8b00-45a5-a72a-eab9bf01b5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29726497e45426f8cac3af336f26fd9, user_id=8a91f740def14572bcedb25ff1770a42, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.335761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab793db-8b00-45a5-a72a-eab9bf01b5ca admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.351021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 925/1880] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:36 2022] PUT /identity/v3/projects/d29726497e45426f8cac3af336f26fd9/users/8a91f740def14572bcedb25ff1770a42/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:36.355005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c8d6a-0d62-4324-9858-a7251e43ba8b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.365806 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c8d6a-0d62-4324-9858-a7251e43ba8b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.426220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879441d2-72a2-4ecd-92f6-93ab5668a0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.427335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879441d2-72a2-4ecd-92f6-93ab5668a0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.427672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879441d2-72a2-4ecd-92f6-93ab5668a0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.428037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879441d2-72a2-4ecd-92f6-93ab5668a0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.428849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879441d2-72a2-4ecd-92f6-93ab5668a0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.430643 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879441d2-72a2-4ecd-92f6-93ab5668a0d8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.441722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 956/1881] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:36.445868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab793db-8b00-45a5-a72a-eab9bf01b5ca admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.457166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab793db-8b00-45a5-a72a-eab9bf01b5ca admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.462510 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.463496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.463845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.464184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] PATH_INFO: `/v3/projects/d29726497e45426f8cac3af336f26fd9/users/8a91f740def14572bcedb25ff1770a42/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.466612 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29726497e45426f8cac3af336f26fd9, user_id=8a91f740def14572bcedb25ff1770a42, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.468948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.479343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 926/1882] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:36 2022] PUT /identity/v3/projects/d29726497e45426f8cac3af336f26fd9/users/8a91f740def14572bcedb25ff1770a42/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:36.490290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ca0da-2570-4b1b-b5bb-bce227e62e22 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.490575 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ca0da-2570-4b1b-b5bb-bce227e62e22 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.490852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ca0da-2570-4b1b-b5bb-bce227e62e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.517597 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d13ca0da-2570-4b1b-b5bb-bce227e62e22 None None] MFA Rules not processed for user `8a91f740def14572bcedb25ff1770a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:36.518790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d13ca0da-2570-4b1b-b5bb-bce227e62e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:36.583967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 957/1883] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:36.594335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.596126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:36.650140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2501-2a8d-4c0b-a74d-0622b8ffa82d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.653741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.654398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.654811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.655117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.663858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.665265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.674735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 927/1884] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:36.749188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ca0da-2570-4b1b-b5bb-bce227e62e22 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.759183 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ca0da-2570-4b1b-b5bb-bce227e62e22 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.762791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.763461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.763746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.764024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.808280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:36.809946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:36.823164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17493d7-f9ba-4f16-8a21-1813be95c8cf service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:36.825295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.826942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.827105 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16294d-0aed-4c25-bde7-07b3e2df9698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:36.827631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16294d-0aed-4c25-bde7-07b3e2df9698 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:36.827909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16294d-0aed-4c25-bde7-07b3e2df9698 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:36.828255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16294d-0aed-4c25-bde7-07b3e2df9698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:36.830202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7b16294d-0aed-4c25-bde7-07b3e2df9698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:36.837405 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 958/1885] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:36.903087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16294d-0aed-4c25-bde7-07b3e2df9698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:36.904548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16294d-0aed-4c25-bde7-07b3e2df9698 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:36.914070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 928/1886] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:39.472834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:39.474314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:39.540776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1052-9fec-4246-94e3-80ddf32bb010 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:39.545283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:39.546147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:39.546507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:39.546721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] PATH_INFO: `/v3/users/89ed0ec1b7374dab892cda90c197a841` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:39.547914 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ed0ec1b7374dab892cda90c197a841)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:39.549812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:39.595547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ed0ec1b7374dab892cda90c197a841'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:39.602868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ed0ec1b7374dab892cda90c197a841'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:39.614173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ed0ec1b7374dab892cda90c197a841'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:39.614992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ed0ec1b7374dab892cda90c197a841'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:39.633625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ed0ec1b7374dab892cda90c197a841'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:39.646737 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 959/1887] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:39 2022] DELETE /identity/v3/users/89ed0ec1b7374dab892cda90c197a841 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:39.651696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67ea1-edb6-4580-bc3d-93248149d657 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:39.652231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67ea1-edb6-4580-bc3d-93248149d657 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:39.652640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67ea1-edb6-4580-bc3d-93248149d657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:39.670508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-cbb67ea1-edb6-4580-bc3d-93248149d657 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:39.672392 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-cbb67ea1-edb6-4580-bc3d-93248149d657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:39.728742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 929/1888] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:39.738722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:39.740125 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:39.795130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd26b84-141d-4a12-bf7c-afdd641674fc admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:39.799366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837d0c-d5e3-48b9-a8f6-ac074757a9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:39.799952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837d0c-d5e3-48b9-a8f6-ac074757a9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:39.800497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837d0c-d5e3-48b9-a8f6-ac074757a9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:39.800776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837d0c-d5e3-48b9-a8f6-ac074757a9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:39.809639 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00837d0c-d5e3-48b9-a8f6-ac074757a9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:39.811079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00837d0c-d5e3-48b9-a8f6-ac074757a9a4 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:39.820907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 960/1889] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:40.134316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb67ea1-edb6-4580-bc3d-93248149d657 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:40.135696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-cbb67ea1-edb6-4580-bc3d-93248149d657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:40.147313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb67ea1-edb6-4580-bc3d-93248149d657 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:40.152003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:40.152859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:40.153142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:40.153425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] PATH_INFO: `/v3/projects/039982fac968482085e7e0cba11b9cb8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:40.154618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039982fac968482085e7e0cba11b9cb8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:40.157059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:40.201907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039982fac968482085e7e0cba11b9cb8', 'request_id': 'req-d9111b5b-f9d2-4c31-a56e-4b2def3da439'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.209174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039982fac968482085e7e0cba11b9cb8', 'request_id': 'req-d9111b5b-f9d2-4c31-a56e-4b2def3da439'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.214397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039982fac968482085e7e0cba11b9cb8', 'request_id': 'req-d9111b5b-f9d2-4c31-a56e-4b2def3da439'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.225318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] The token cache is being invalidate because project 039982fac968482085e7e0cba11b9cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:40.225602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.226217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.227781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 930/1890] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:40 2022] DELETE /identity/v3/projects/039982fac968482085e7e0cba11b9cb8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:40.231762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837d0c-d5e3-48b9-a8f6-ac074757a9a4 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:40.248629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837d0c-d5e3-48b9-a8f6-ac074757a9a4 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:40.317945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:40.318859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:40.319196 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:40.319471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] PATH_INFO: `/v3/users/8b5c52b1e41e4f01bd276cacc30026a1` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:40.320672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5c52b1e41e4f01bd276cacc30026a1)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:40.322633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:40.369344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5c52b1e41e4f01bd276cacc30026a1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.376215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5c52b1e41e4f01bd276cacc30026a1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.384618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5c52b1e41e4f01bd276cacc30026a1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.385273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5c52b1e41e4f01bd276cacc30026a1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.397465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5241a8ba-c35a-45d3-bd54-204dad3dca07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5c52b1e41e4f01bd276cacc30026a1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.403361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 961/1891] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:40 2022] DELETE /identity/v3/users/8b5c52b1e41e4f01bd276cacc30026a1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:40.662611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:40.664084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:40.677058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9111b5b-f9d2-4c31-a56e-4b2def3da439 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:40.744084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:40.744957 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:40.745233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:40.745503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] PATH_INFO: `/v3/projects/508d974083e94ff8ab308fc180cb65e5` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:40.746705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=508d974083e94ff8ab308fc180cb65e5)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:40.748652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:40.794120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508d974083e94ff8ab308fc180cb65e5', 'request_id': 'req-3f70003e-0347-4344-ba63-da12d09bf708'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.801537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508d974083e94ff8ab308fc180cb65e5', 'request_id': 'req-3f70003e-0347-4344-ba63-da12d09bf708'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.807095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508d974083e94ff8ab308fc180cb65e5', 'request_id': 'req-3f70003e-0347-4344-ba63-da12d09bf708'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.818804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] The token cache is being invalidate because project 508d974083e94ff8ab308fc180cb65e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:40.819124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.819766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3f70003e-0347-4344-ba63-da12d09bf708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:40.821568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 931/1892] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:40 2022] DELETE /identity/v3/projects/508d974083e94ff8ab308fc180cb65e5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:40.826304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dfc33-95b8-457f-9c8c-53bf59d3c31d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:40.826790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dfc33-95b8-457f-9c8c-53bf59d3c31d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:40.826908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dfc33-95b8-457f-9c8c-53bf59d3c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:40.845940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-502dfc33-95b8-457f-9c8c-53bf59d3c31d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:40.847227 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-502dfc33-95b8-457f-9c8c-53bf59d3c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:40.904695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 962/1893] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:40.913737 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56878f1-a81a-4059-96a0-48b152b49620 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:40.914027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56878f1-a81a-4059-96a0-48b152b49620 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:40.914311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56878f1-a81a-4059-96a0-48b152b49620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:40.932419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-a56878f1-a81a-4059-96a0-48b152b49620 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:40.933621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a56878f1-a81a-4059-96a0-48b152b49620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:40.942110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 932/1894] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:40.946179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dfc33-95b8-457f-9c8c-53bf59d3c31d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:40.956289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dfc33-95b8-457f-9c8c-53bf59d3c31d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:40.960743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:40.961388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:40.961667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:40.961939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:40.962659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:40.962978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:40.964548 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:40.975805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 963/1895] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:40.979729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56878f1-a81a-4059-96a0-48b152b49620 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:40.988619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56878f1-a81a-4059-96a0-48b152b49620 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:40.993231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634502e-0f98-4d15-a090-cb01289ca785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:40.993878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634502e-0f98-4d15-a090-cb01289ca785 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:40.994161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634502e-0f98-4d15-a090-cb01289ca785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:40.994437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634502e-0f98-4d15-a090-cb01289ca785 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:40.995154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634502e-0f98-4d15-a090-cb01289ca785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:40.997047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634502e-0f98-4d15-a090-cb01289ca785 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.025316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 933/1896] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:40 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:41.027632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.037308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27cc7b-8952-4a7f-99f2-f3d817be2464 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.092838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b2ae-94c7-40ec-8eb9-eb2165970fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.093695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b2ae-94c7-40ec-8eb9-eb2165970fab admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.094055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b2ae-94c7-40ec-8eb9-eb2165970fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.094335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83b2ae-94c7-40ec-8eb9-eb2165970fab admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.095054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83b2ae-94c7-40ec-8eb9-eb2165970fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.097007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83b2ae-94c7-40ec-8eb9-eb2165970fab admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.117408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 964/1897] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:41 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:41.121411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634502e-0f98-4d15-a090-cb01289ca785 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.132202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634502e-0f98-4d15-a090-cb01289ca785 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.136748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e124b81-c1a6-4245-9efc-2df58cbf5a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.137402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124b81-c1a6-4245-9efc-2df58cbf5a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.137682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124b81-c1a6-4245-9efc-2df58cbf5a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.137949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124b81-c1a6-4245-9efc-2df58cbf5a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.138670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e124b81-c1a6-4245-9efc-2df58cbf5a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.140360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e124b81-c1a6-4245-9efc-2df58cbf5a0d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.155790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 934/1898] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:41.157029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b2ae-94c7-40ec-8eb9-eb2165970fab admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.166995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83b2ae-94c7-40ec-8eb9-eb2165970fab admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.172068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c527c8-e4fa-43b2-aa59-5cb3319a36e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.172724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c527c8-e4fa-43b2-aa59-5cb3319a36e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.173005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c527c8-e4fa-43b2-aa59-5cb3319a36e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.173279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c527c8-e4fa-43b2-aa59-5cb3319a36e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.173998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c527c8-e4fa-43b2-aa59-5cb3319a36e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.175889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c527c8-e4fa-43b2-aa59-5cb3319a36e4 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.185870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 965/1899] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:41.190434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e124b81-c1a6-4245-9efc-2df58cbf5a0d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.200290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e124b81-c1a6-4245-9efc-2df58cbf5a0d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.204958 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f2c3c-c08c-4e3c-9993-d174385568d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.205833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2c3c-c08c-4e3c-9993-d174385568d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.206112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2c3c-c08c-4e3c-9993-d174385568d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.206381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2c3c-c08c-4e3c-9993-d174385568d4 admin admin] PATH_INFO: `/v3/projects/8e6e046b9f1c41fa8d08969f7012b946/users/21cb655e726a40fe97da80604b718e2a/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.220615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f2c3c-c08c-4e3c-9993-d174385568d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6e046b9f1c41fa8d08969f7012b946, user_id=21cb655e726a40fe97da80604b718e2a, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.223255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f2c3c-c08c-4e3c-9993-d174385568d4 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.236619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 935/1900] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:41 2022] PUT /identity/v3/projects/8e6e046b9f1c41fa8d08969f7012b946/users/21cb655e726a40fe97da80604b718e2a/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:41.246573 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63dc19-9a79-4906-811f-399a2a2d3c44 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.246904 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63dc19-9a79-4906-811f-399a2a2d3c44 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.247228 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63dc19-9a79-4906-811f-399a2a2d3c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.274698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-6e63dc19-9a79-4906-811f-399a2a2d3c44 None None] MFA Rules not processed for user `21cb655e726a40fe97da80604b718e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:41.275978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6e63dc19-9a79-4906-811f-399a2a2d3c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:41.339011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 966/1901] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:41.343501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f2c3c-c08c-4e3c-9993-d174385568d4 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.402659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f2c3c-c08c-4e3c-9993-d174385568d4 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.407368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83f5a9-6a1e-4571-9e2e-dcdeb8461c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.408011 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f5a9-6a1e-4571-9e2e-dcdeb8461c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.408295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f5a9-6a1e-4571-9e2e-dcdeb8461c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.408571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f5a9-6a1e-4571-9e2e-dcdeb8461c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.409262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83f5a9-6a1e-4571-9e2e-dcdeb8461c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.411200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83f5a9-6a1e-4571-9e2e-dcdeb8461c83 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.436649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 936/1902] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:41 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:41.441215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63dc19-9a79-4906-811f-399a2a2d3c44 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.452291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63dc19-9a79-4906-811f-399a2a2d3c44 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.508568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b0be-d48e-4a69-80ac-0bcbfbe411b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.509250 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b0be-d48e-4a69-80ac-0bcbfbe411b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.509532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b0be-d48e-4a69-80ac-0bcbfbe411b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.509810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b0be-d48e-4a69-80ac-0bcbfbe411b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.510516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639b0be-d48e-4a69-80ac-0bcbfbe411b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.512494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639b0be-d48e-4a69-80ac-0bcbfbe411b2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.532925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 967/1903] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:41 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:41.536874 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83f5a9-6a1e-4571-9e2e-dcdeb8461c83 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.547808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83f5a9-6a1e-4571-9e2e-dcdeb8461c83 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.553317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d67a1-1435-466e-98c8-e6f6de4a63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.553984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d67a1-1435-466e-98c8-e6f6de4a63eb admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.554264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d67a1-1435-466e-98c8-e6f6de4a63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.554573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d67a1-1435-466e-98c8-e6f6de4a63eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.555290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d67a1-1435-466e-98c8-e6f6de4a63eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.556895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d67a1-1435-466e-98c8-e6f6de4a63eb admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.571136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 937/1904] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:41.572110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b0be-d48e-4a69-80ac-0bcbfbe411b2 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.582468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b0be-d48e-4a69-80ac-0bcbfbe411b2 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.589433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07767e5-6603-44f8-ad81-0f219cf5f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.590122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07767e5-6603-44f8-ad81-0f219cf5f24e admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.590407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07767e5-6603-44f8-ad81-0f219cf5f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.590687 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07767e5-6603-44f8-ad81-0f219cf5f24e admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.591452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07767e5-6603-44f8-ad81-0f219cf5f24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.593028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07767e5-6603-44f8-ad81-0f219cf5f24e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.603550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 968/1905] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:41.607375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d67a1-1435-466e-98c8-e6f6de4a63eb admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.617618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d67a1-1435-466e-98c8-e6f6de4a63eb admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.622152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f643a-a844-4381-ada1-8abca5cdc1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.623039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f643a-a844-4381-ada1-8abca5cdc1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.623323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f643a-a844-4381-ada1-8abca5cdc1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.623600 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f643a-a844-4381-ada1-8abca5cdc1dd admin admin] PATH_INFO: `/v3/projects/b1e2bcbf651b49c9b494dd259a32c5aa/users/be303d707d40487d9a2a4a10e25de120/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.638317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f643a-a844-4381-ada1-8abca5cdc1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e2bcbf651b49c9b494dd259a32c5aa, user_id=be303d707d40487d9a2a4a10e25de120, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.641024 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f643a-a844-4381-ada1-8abca5cdc1dd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.653996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 938/1906] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:41 2022] PUT /identity/v3/projects/b1e2bcbf651b49c9b494dd259a32c5aa/users/be303d707d40487d9a2a4a10e25de120/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:41.664619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bda1e-e8c1-408b-9594-da7c97fc575b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.664907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bda1e-e8c1-408b-9594-da7c97fc575b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.665239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bda1e-e8c1-408b-9594-da7c97fc575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.693007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-0a5bda1e-e8c1-408b-9594-da7c97fc575b None None] MFA Rules not processed for user `be303d707d40487d9a2a4a10e25de120`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:41.694220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0a5bda1e-e8c1-408b-9594-da7c97fc575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:41.761645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 969/1907] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:41.766500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f643a-a844-4381-ada1-8abca5cdc1dd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.835581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f643a-a844-4381-ada1-8abca5cdc1dd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.840860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c92a7-5df0-4001-8481-19a2938affb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.841515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c92a7-5df0-4001-8481-19a2938affb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.841801 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c92a7-5df0-4001-8481-19a2938affb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.842067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c92a7-5df0-4001-8481-19a2938affb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.842743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c92a7-5df0-4001-8481-19a2938affb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.844828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c92a7-5df0-4001-8481-19a2938affb1 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.880685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 939/1908] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:41 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:41.883599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bda1e-e8c1-408b-9594-da7c97fc575b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.896454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bda1e-e8c1-408b-9594-da7c97fc575b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:41.956919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f72f8f-c9e4-4a24-bdb2-dc2443c5ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:41.957597 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72f8f-c9e4-4a24-bdb2-dc2443c5ac84 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:41.957876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72f8f-c9e4-4a24-bdb2-dc2443c5ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:41.958149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f72f8f-c9e4-4a24-bdb2-dc2443c5ac84 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:41.958832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72f8f-c9e4-4a24-bdb2-dc2443c5ac84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:41.960849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f72f8f-c9e4-4a24-bdb2-dc2443c5ac84 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:41.984733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 970/1909] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:41 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:41.985947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c92a7-5df0-4001-8481-19a2938affb1 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:41.997407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c92a7-5df0-4001-8481-19a2938affb1 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:42.002643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fc2d-b969-4c31-9c0e-07b00d01de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:42.003446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fc2d-b969-4c31-9c0e-07b00d01de20 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:42.003727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fc2d-b969-4c31-9c0e-07b00d01de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:42.004002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fc2d-b969-4c31-9c0e-07b00d01de20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:42.004729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fc2d-b969-4c31-9c0e-07b00d01de20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:42.006337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643fc2d-b969-4c31-9c0e-07b00d01de20 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:42.017041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 940/1910] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:42.021112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f72f8f-c9e4-4a24-bdb2-dc2443c5ac84 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:42.031752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f72f8f-c9e4-4a24-bdb2-dc2443c5ac84 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:42.039916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1558-8985-4902-b72d-95eaa82b55ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:42.040812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1558-8985-4902-b72d-95eaa82b55ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:42.041099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1558-8985-4902-b72d-95eaa82b55ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:42.041374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1558-8985-4902-b72d-95eaa82b55ba admin admin] PATH_INFO: `/v3/projects/853083d37bf34b3eacb0ae49fd39a355/users/6cae3a9e0d0b4083b94fd4797121f16c/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:42.058524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1558-8985-4902-b72d-95eaa82b55ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=853083d37bf34b3eacb0ae49fd39a355, user_id=6cae3a9e0d0b4083b94fd4797121f16c, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:42.061269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1558-8985-4902-b72d-95eaa82b55ba admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:42.078402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 971/1911] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:42 2022] PUT /identity/v3/projects/853083d37bf34b3eacb0ae49fd39a355/users/6cae3a9e0d0b4083b94fd4797121f16c/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:42.082533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fc2d-b969-4c31-9c0e-07b00d01de20 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:42.092889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fc2d-b969-4c31-9c0e-07b00d01de20 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:42.158764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5e82-e855-4618-b29d-cd33ec2f04ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:42.159503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5e82-e855-4618-b29d-cd33ec2f04ed admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:42.159792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5e82-e855-4618-b29d-cd33ec2f04ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:42.160102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5e82-e855-4618-b29d-cd33ec2f04ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:42.161099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c5e82-e855-4618-b29d-cd33ec2f04ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:42.163115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c5e82-e855-4618-b29d-cd33ec2f04ed admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:42.174912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 941/1912] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:42.179592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1558-8985-4902-b72d-95eaa82b55ba admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:42.191927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1558-8985-4902-b72d-95eaa82b55ba admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:42.196762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:42.197718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:42.198067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:42.198567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] PATH_INFO: `/v3/projects/853083d37bf34b3eacb0ae49fd39a355/users/6cae3a9e0d0b4083b94fd4797121f16c/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:42.200840 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=853083d37bf34b3eacb0ae49fd39a355, user_id=6cae3a9e0d0b4083b94fd4797121f16c, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:42.203684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:42.215056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 972/1913] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:42 2022] PUT /identity/v3/projects/853083d37bf34b3eacb0ae49fd39a355/users/6cae3a9e0d0b4083b94fd4797121f16c/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:42.226583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50cdde-a650-4079-b750-8ad4cc697f6f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:42.226929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50cdde-a650-4079-b750-8ad4cc697f6f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:42.227246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50cdde-a650-4079-b750-8ad4cc697f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:42.260674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1d50cdde-a650-4079-b750-8ad4cc697f6f None None] MFA Rules not processed for user `6cae3a9e0d0b4083b94fd4797121f16c`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:42.261901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1d50cdde-a650-4079-b750-8ad4cc697f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:42.376674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 942/1914] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:42.413468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:42.420273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:42.501047 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56a21-9a63-4b7e-9c6e-705e763994ff admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:42.505937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:42.506806 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:42.507285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:42.507647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:42.571704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:42.573320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:42.584287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 973/1915] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:50.475111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50cdde-a650-4079-b750-8ad4cc697f6f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:50.476730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1d50cdde-a650-4079-b750-8ad4cc697f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:50.489446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50cdde-a650-4079-b750-8ad4cc697f6f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:50.494135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbc977-cfd7-4328-8acc-2d784a42b82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:50.494814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbc977-cfd7-4328-8acc-2d784a42b82c service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:50.495144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbc977-cfd7-4328-8acc-2d784a42b82c service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:50.495428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbc977-cfd7-4328-8acc-2d784a42b82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:50.570948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbc977-cfd7-4328-8acc-2d784a42b82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:50.572619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbc977-cfd7-4328-8acc-2d784a42b82c service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:50.583788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 943/1916] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:51.208651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:51.210100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:51.289233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbc977-cfd7-4328-8acc-2d784a42b82c service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:51.291203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58fdbe-17bf-4580-a65b-367187a8381b service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:51.297066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:51.298167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:51.298457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:51.298731 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] PATH_INFO: `/v3/users/47aba572029047108b6827bf2db59f09` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:51.300001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47aba572029047108b6827bf2db59f09)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:51.302100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbc977-cfd7-4328-8acc-2d784a42b82c service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:51.302224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:51.306327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c01af-09d6-42ae-8f01-85edca3e38d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:51.307177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c01af-09d6-42ae-8f01-85edca3e38d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:51.307457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c01af-09d6-42ae-8f01-85edca3e38d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:51.307737 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c01af-09d6-42ae-8f01-85edca3e38d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:51.317265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c01af-09d6-42ae-8f01-85edca3e38d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:51.318697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c01af-09d6-42ae-8f01-85edca3e38d8 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:51.328376 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 944/1917] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:51.353749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47aba572029047108b6827bf2db59f09'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:51.362120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47aba572029047108b6827bf2db59f09'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:51.370581 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47aba572029047108b6827bf2db59f09'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:51.372400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47aba572029047108b6827bf2db59f09'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:51.387108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47aba572029047108b6827bf2db59f09'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:51.397038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 974/1918] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:51 2022] DELETE /identity/v3/users/47aba572029047108b6827bf2db59f09 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:51.403331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc064-46e6-4a0c-a5e4-99723817c7ed None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:51.403331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc064-46e6-4a0c-a5e4-99723817c7ed None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:51.403331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc064-46e6-4a0c-a5e4-99723817c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:51.423324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e83bc064-46e6-4a0c-a5e4-99723817c7ed None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:51.424547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e83bc064-46e6-4a0c-a5e4-99723817c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:51.499883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 945/1919] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:51.513791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:51.516027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:51.584829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca8d2-06ae-4b83-8db4-a7d15753ec80 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:51.589657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65858400-6c17-4f0b-95cf-010b209c4e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:51.589897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65858400-6c17-4f0b-95cf-010b209c4e7a service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:51.590184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65858400-6c17-4f0b-95cf-010b209c4e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:51.590460 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65858400-6c17-4f0b-95cf-010b209c4e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:51.603773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65858400-6c17-4f0b-95cf-010b209c4e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:51.605513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65858400-6c17-4f0b-95cf-010b209c4e7a service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:51.621286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 975/1920] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:51.943762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bc064-46e6-4a0c-a5e4-99723817c7ed None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:51.945434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e83bc064-46e6-4a0c-a5e4-99723817c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:51.961504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bc064-46e6-4a0c-a5e4-99723817c7ed None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:51.977756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:51.978626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:51.978907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:51.979214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] PATH_INFO: `/v3/projects/89e452cf721c4b2a8176d6364a7a9966` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:51.980391 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e452cf721c4b2a8176d6364a7a9966)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:51.982297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:52.031584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e452cf721c4b2a8176d6364a7a9966', 'request_id': 'req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.039712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e452cf721c4b2a8176d6364a7a9966', 'request_id': 'req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.046920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e452cf721c4b2a8176d6364a7a9966', 'request_id': 'req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.059334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] The token cache is being invalidate because project 89e452cf721c4b2a8176d6364a7a9966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:52.059669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.060494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.062330 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 946/1921] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:51 2022] DELETE /identity/v3/projects/89e452cf721c4b2a8176d6364a7a9966 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:52.066452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65858400-6c17-4f0b-95cf-010b209c4e7a service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:52.076210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65858400-6c17-4f0b-95cf-010b209c4e7a service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:52.140442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:52.141385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:52.141672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:52.142095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] PATH_INFO: `/v3/users/8a91f740def14572bcedb25ff1770a42` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:52.143673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a91f740def14572bcedb25ff1770a42)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:52.145839 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:52.206210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a91f740def14572bcedb25ff1770a42'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.212837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a91f740def14572bcedb25ff1770a42'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.221431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a91f740def14572bcedb25ff1770a42'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.222078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a91f740def14572bcedb25ff1770a42'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.234348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a91f740def14572bcedb25ff1770a42'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.240287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 976/1922] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:52 2022] DELETE /identity/v3/users/8a91f740def14572bcedb25ff1770a42 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:52.508991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:52.510655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:52.524261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e2a43-f082-4ba5-a5e9-ba9b2e06fd8f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:52.595701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:52.596564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:52.596847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:52.597117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] PATH_INFO: `/v3/projects/d29726497e45426f8cac3af336f26fd9` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:52.598294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29726497e45426f8cac3af336f26fd9)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:52.600222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:52.645390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:52.646953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:52.649401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29726497e45426f8cac3af336f26fd9', 'request_id': 'req-33d48078-66f8-4736-847f-88a4c55414a5'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.668986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa082-56f0-40c1-945a-7855df14f48c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:52.669193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29726497e45426f8cac3af336f26fd9', 'request_id': 'req-33d48078-66f8-4736-847f-88a4c55414a5'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.683968 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29726497e45426f8cac3af336f26fd9', 'request_id': 'req-33d48078-66f8-4736-847f-88a4c55414a5'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.711713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] The token cache is being invalidate because project d29726497e45426f8cac3af336f26fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:52.712201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.713575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-33d48078-66f8-4736-847f-88a4c55414a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.715886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 947/1923] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:52 2022] DELETE /identity/v3/projects/d29726497e45426f8cac3af336f26fd9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:52.722776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18b5f-5da4-4ea5-bc5e-7f0dc5cfd356 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:52.723929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18b5f-5da4-4ea5-bc5e-7f0dc5cfd356 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:52.734246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18b5f-5da4-4ea5-bc5e-7f0dc5cfd356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:52.737781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:52.738878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:52.739267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:52.739607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] PATH_INFO: `/v3/users/0d2ed11084df45b6bf338999d63951b4` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:52.741267 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2ed11084df45b6bf338999d63951b4)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:52.744183 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:52.781242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-51e18b5f-5da4-4ea5-bc5e-7f0dc5cfd356 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:52.782733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-51e18b5f-5da4-4ea5-bc5e-7f0dc5cfd356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:52.803667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 948/1924] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:52.812583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d4d1-cc28-4aaa-99c7-e3583c1be6d8 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:52.814567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d4d1-cc28-4aaa-99c7-e3583c1be6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:52.814925 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d4d1-cc28-4aaa-99c7-e3583c1be6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:52.831440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2ed11084df45b6bf338999d63951b4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.840319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2ed11084df45b6bf338999d63951b4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.852034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e5c7d4d1-cc28-4aaa-99c7-e3583c1be6d8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:52.853685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e5c7d4d1-cc28-4aaa-99c7-e3583c1be6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:52.853808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2ed11084df45b6bf338999d63951b4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.855369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2ed11084df45b6bf338999d63951b4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.869740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 949/1925] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:52.870810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7d4d1-cc28-4aaa-99c7-e3583c1be6d8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:52.877846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-66909326-a267-41d1-ba8f-125bbdbf3136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2ed11084df45b6bf338999d63951b4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:52.880926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7d4d1-cc28-4aaa-99c7-e3583c1be6d8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:52.885826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 977/1926] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:52 2022] DELETE /identity/v3/users/0d2ed11084df45b6bf338999d63951b4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:52.890810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c209-45fb-4d73-a597-8fdb16682861 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:52.891131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c209-45fb-4d73-a597-8fdb16682861 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:52.891407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c209-45fb-4d73-a597-8fdb16682861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:52.891499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:52.892446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:52.892722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:52.893151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:52.894170 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:52.894485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:52.896213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:52.908906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 950/1927] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:52.913138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:52.917556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7bc9c209-45fb-4d73-a597-8fdb16682861 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:52.918985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7bc9c209-45fb-4d73-a597-8fdb16682861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:52.922976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c97d52-13e8-4681-98e9-3120b3a1faa9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:52.982924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 978/1928] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:52.989902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be90-1f20-4f10-b37c-d81619d139ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:52.990598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be90-1f20-4f10-b37c-d81619d139ba admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:52.990896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be90-1f20-4f10-b37c-d81619d139ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:52.991189 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be90-1f20-4f10-b37c-d81619d139ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:52.991881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3be90-1f20-4f10-b37c-d81619d139ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:52.993479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9c209-45fb-4d73-a597-8fdb16682861 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:52.993796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3be90-1f20-4f10-b37c-d81619d139ba admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:52.996010 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7bc9c209-45fb-4d73-a597-8fdb16682861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:53.031022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 951/1929] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:52 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:53.033396 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be90-1f20-4f10-b37c-d81619d139ba admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.066912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9c209-45fb-4d73-a597-8fdb16682861 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.108271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be90-1f20-4f10-b37c-d81619d139ba admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.114097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1c408-360e-46c3-bb6a-d74bca3f1c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.114806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1c408-360e-46c3-bb6a-d74bca3f1c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.115134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1c408-360e-46c3-bb6a-d74bca3f1c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.115408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1c408-360e-46c3-bb6a-d74bca3f1c78 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.116094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1c408-360e-46c3-bb6a-d74bca3f1c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.118322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1c408-360e-46c3-bb6a-d74bca3f1c78 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.121832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9423a-42bb-4684-8cf0-5f34ed882871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.122549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9423a-42bb-4684-8cf0-5f34ed882871 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.122837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9423a-42bb-4684-8cf0-5f34ed882871 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.123258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9423a-42bb-4684-8cf0-5f34ed882871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.134690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9423a-42bb-4684-8cf0-5f34ed882871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.136148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9423a-42bb-4684-8cf0-5f34ed882871 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.142997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 952/1930] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:53 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:53.145884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1c408-360e-46c3-bb6a-d74bca3f1c78 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.147070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 979/1931] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:53.157564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1c408-360e-46c3-bb6a-d74bca3f1c78 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.163654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7d5d-36dc-4345-a064-73221afc8636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.164388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7d5d-36dc-4345-a064-73221afc8636 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.164840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7d5d-36dc-4345-a064-73221afc8636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.165176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e7d5d-36dc-4345-a064-73221afc8636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.166059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e7d5d-36dc-4345-a064-73221afc8636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.170047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e7d5d-36dc-4345-a064-73221afc8636 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.180256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 953/1932] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:53.185358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9423a-42bb-4684-8cf0-5f34ed882871 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.216194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9423a-42bb-4684-8cf0-5f34ed882871 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.233002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ead9-c5bb-46fe-8a95-a61e7512aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.237563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ead9-c5bb-46fe-8a95-a61e7512aee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.237902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ead9-c5bb-46fe-8a95-a61e7512aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.238253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ead9-c5bb-46fe-8a95-a61e7512aee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.239323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2ead9-c5bb-46fe-8a95-a61e7512aee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.240929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2ead9-c5bb-46fe-8a95-a61e7512aee5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.252572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 980/1933] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:53.256698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7d5d-36dc-4345-a064-73221afc8636 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.268862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e7d5d-36dc-4345-a064-73221afc8636 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.276350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1159dd7-e43e-43bc-8fe0-5df756de897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.277563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1159dd7-e43e-43bc-8fe0-5df756de897f admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.277950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1159dd7-e43e-43bc-8fe0-5df756de897f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.279249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1159dd7-e43e-43bc-8fe0-5df756de897f admin admin] PATH_INFO: `/v3/projects/7254cf7f2c4e4b5590bfaa9e19da3311/users/0f62ed8d573a4e7f8326cbbe98d89ee6/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.298418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1159dd7-e43e-43bc-8fe0-5df756de897f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7254cf7f2c4e4b5590bfaa9e19da3311, user_id=0f62ed8d573a4e7f8326cbbe98d89ee6, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.301999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1159dd7-e43e-43bc-8fe0-5df756de897f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.317427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 954/1934] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:53 2022] PUT /identity/v3/projects/7254cf7f2c4e4b5590bfaa9e19da3311/users/0f62ed8d573a4e7f8326cbbe98d89ee6/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:53.328864 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d731b7-104b-41b1-9ca7-c1b0af1e5cff None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.329152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d731b7-104b-41b1-9ca7-c1b0af1e5cff None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.329428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d731b7-104b-41b1-9ca7-c1b0af1e5cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.357600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a0d731b7-104b-41b1-9ca7-c1b0af1e5cff None None] MFA Rules not processed for user `0f62ed8d573a4e7f8326cbbe98d89ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:53.359385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a0d731b7-104b-41b1-9ca7-c1b0af1e5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:53.438430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 981/1935] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:53.442572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1159dd7-e43e-43bc-8fe0-5df756de897f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.484745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d731b7-104b-41b1-9ca7-c1b0af1e5cff None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.486754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a0d731b7-104b-41b1-9ca7-c1b0af1e5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:53.506441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1159dd7-e43e-43bc-8fe0-5df756de897f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.511426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d714b-69ac-471a-bf79-ea2cfa7a58c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.512168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d714b-69ac-471a-bf79-ea2cfa7a58c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.512526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d714b-69ac-471a-bf79-ea2cfa7a58c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.512877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d714b-69ac-471a-bf79-ea2cfa7a58c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.513676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d714b-69ac-471a-bf79-ea2cfa7a58c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.515845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d714b-69ac-471a-bf79-ea2cfa7a58c5 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.546918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 955/1936] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:53 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:53.548865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d714b-69ac-471a-bf79-ea2cfa7a58c5 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.560217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d731b7-104b-41b1-9ca7-c1b0af1e5cff None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.609260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d714b-69ac-471a-bf79-ea2cfa7a58c5 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.613889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0152f0a-c14b-4ead-aea6-d909e5166632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.614556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152f0a-c14b-4ead-aea6-d909e5166632 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.614842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152f0a-c14b-4ead-aea6-d909e5166632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.615124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.615252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152f0a-c14b-4ead-aea6-d909e5166632 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.615824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0152f0a-c14b-4ead-aea6-d909e5166632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.615975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.616256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.616528 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] PATH_INFO: `/v3/projects/2a646ae3faff4b488c14d11c3097a5e0` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.617688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a646ae3faff4b488c14d11c3097a5e0)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.617787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0152f0a-c14b-4ead-aea6-d909e5166632 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.619624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.640249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 956/1937] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:53 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:53.641379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0152f0a-c14b-4ead-aea6-d909e5166632 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.651759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0152f0a-c14b-4ead-aea6-d909e5166632 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.657525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee073f-33f5-453b-bdd1-52e64ddd3179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.658177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee073f-33f5-453b-bdd1-52e64ddd3179 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.658459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee073f-33f5-453b-bdd1-52e64ddd3179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.658730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee073f-33f5-453b-bdd1-52e64ddd3179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.659676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee073f-33f5-453b-bdd1-52e64ddd3179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.661411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee073f-33f5-453b-bdd1-52e64ddd3179 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.666698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a646ae3faff4b488c14d11c3097a5e0', 'request_id': 'req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.672156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 957/1938] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:53.674195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a646ae3faff4b488c14d11c3097a5e0', 'request_id': 'req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.676493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee073f-33f5-453b-bdd1-52e64ddd3179 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.679907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a646ae3faff4b488c14d11c3097a5e0', 'request_id': 'req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.685863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee073f-33f5-453b-bdd1-52e64ddd3179 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.690672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] The token cache is being invalidate because project 2a646ae3faff4b488c14d11c3097a5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:53.690971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.691631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.693218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 982/1939] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:53 2022] DELETE /identity/v3/projects/2a646ae3faff4b488c14d11c3097a5e0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:53.696881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.698123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:53.741313 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.742746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.743297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.743824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] PATH_INFO: `/v3/projects/e4bc02c563ad449e98c0ae4b16500712/users/0ab6d8143fbc472c8d1017296b364981/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.759831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bc02c563ad449e98c0ae4b16500712, user_id=0ab6d8143fbc472c8d1017296b364981, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.762481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.763022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1bb5c-b35b-44e7-88fd-52a8fe63cc2f admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.767792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.768735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.769012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.769282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] PATH_INFO: `/v3/users/648ddac924f24806ad3ac5db2e6dcca4` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.770552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648ddac924f24806ad3ac5db2e6dcca4)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.772522 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.775689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 958/1940] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:53 2022] PUT /identity/v3/projects/e4bc02c563ad449e98c0ae4b16500712/users/0ab6d8143fbc472c8d1017296b364981/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:53.779704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.781835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:53.818268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648ddac924f24806ad3ac5db2e6dcca4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.824861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648ddac924f24806ad3ac5db2e6dcca4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.832507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648ddac924f24806ad3ac5db2e6dcca4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.833280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648ddac924f24806ad3ac5db2e6dcca4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.845877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648ddac924f24806ad3ac5db2e6dcca4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:53.846298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3c23-d501-40ba-9296-ce769566a627 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.853104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ea015-9e7f-4d75-ac48-fdb0be53cb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.855185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 983/1941] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:53 2022] DELETE /identity/v3/users/648ddac924f24806ad3ac5db2e6dcca4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:53.855373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ea015-9e7f-4d75-ac48-fdb0be53cb1f admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.855849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ea015-9e7f-4d75-ac48-fdb0be53cb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.855849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ea015-9e7f-4d75-ac48-fdb0be53cb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.856623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ea015-9e7f-4d75-ac48-fdb0be53cb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.859302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ea015-9e7f-4d75-ac48-fdb0be53cb1f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.870461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 959/1942] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:53.874525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:53.875992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:53.948089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e82dd-25af-4105-9cd6-ff4d16a861e0 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:53.957209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:53.958638 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.958975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.959280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] PATH_INFO: `/v3/projects/e4bc02c563ad449e98c0ae4b16500712/users/0ab6d8143fbc472c8d1017296b364981/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:53.961617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bc02c563ad449e98c0ae4b16500712, user_id=0ab6d8143fbc472c8d1017296b364981, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:53.967379 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:53.982540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 984/1943] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:53 2022] PUT /identity/v3/projects/e4bc02c563ad449e98c0ae4b16500712/users/0ab6d8143fbc472c8d1017296b364981/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:53.993240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dabfc0-62d6-459e-b396-4daa5701c885 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:53.993566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dabfc0-62d6-459e-b396-4daa5701c885 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:53.993895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dabfc0-62d6-459e-b396-4daa5701c885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.024305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-81dabfc0-62d6-459e-b396-4daa5701c885 None None] MFA Rules not processed for user `0ab6d8143fbc472c8d1017296b364981`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:54.025727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-81dabfc0-62d6-459e-b396-4daa5701c885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.099220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 960/1944] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:54.111453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.113273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.165040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dabfc0-62d6-459e-b396-4daa5701c885 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.166448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-81dabfc0-62d6-459e-b396-4daa5701c885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.181713 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4bb65-ed25-48ab-9ac1-1edb6633eb01 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.185501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701f4d-82a3-4064-8573-6ee5e6524042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.186154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701f4d-82a3-4064-8573-6ee5e6524042 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.186441 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701f4d-82a3-4064-8573-6ee5e6524042 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.186755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701f4d-82a3-4064-8573-6ee5e6524042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.198437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd701f4d-82a3-4064-8573-6ee5e6524042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.199974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd701f4d-82a3-4064-8573-6ee5e6524042 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.210030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 985/1945] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:54.233689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dabfc0-62d6-459e-b396-4daa5701c885 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.239462 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.241616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.241616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.241616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] PATH_INFO: `/v3/projects/92fa8a1bf81040a587d844adb2fec446` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.242593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92fa8a1bf81040a587d844adb2fec446)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.244674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.302697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701f4d-82a3-4064-8573-6ee5e6524042 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.304904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92fa8a1bf81040a587d844adb2fec446', 'request_id': 'req-828ffdab-9e56-4ec7-9e0f-122343c54980'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.309335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701f4d-82a3-4064-8573-6ee5e6524042 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.314554 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92fa8a1bf81040a587d844adb2fec446', 'request_id': 'req-828ffdab-9e56-4ec7-9e0f-122343c54980'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.320263 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92fa8a1bf81040a587d844adb2fec446', 'request_id': 'req-828ffdab-9e56-4ec7-9e0f-122343c54980'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.331468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] The token cache is being invalidate because project 92fa8a1bf81040a587d844adb2fec446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:54.331756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.332416 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-828ffdab-9e56-4ec7-9e0f-122343c54980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.333999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 961/1946] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:54 2022] DELETE /identity/v3/projects/92fa8a1bf81040a587d844adb2fec446 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:54.338930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba58a-74bb-42fd-8dfa-5f86da3b1e70 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.339253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba58a-74bb-42fd-8dfa-5f86da3b1e70 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.339532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ba58a-74bb-42fd-8dfa-5f86da3b1e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.357844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-986ba58a-74bb-42fd-8dfa-5f86da3b1e70 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:54.358083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.359333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.359645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-986ba58a-74bb-42fd-8dfa-5f86da3b1e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.359745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.359923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.361741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.416216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 962/1947] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:54.424282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb284b-82f2-4a38-b5fa-c4dda0346ba5 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.424534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.424637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb284b-82f2-4a38-b5fa-c4dda0346ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.424828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb284b-82f2-4a38-b5fa-c4dda0346ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.426242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.436586 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 986/1948] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:54.446289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6acb284b-82f2-4a38-b5fa-c4dda0346ba5 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:54.447522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6acb284b-82f2-4a38-b5fa-c4dda0346ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.455622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 963/1949] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:54.460414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.471955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe09fb1-8312-49eb-ab05-dd94c94ce060 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.477633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.478302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.478585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.478861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.479626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:54.479935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.481698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.495282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 987/1950] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:54.499816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb284b-82f2-4a38-b5fa-c4dda0346ba5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.509508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb284b-82f2-4a38-b5fa-c4dda0346ba5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.515415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37e84-668a-41ea-8904-4e362131c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.516857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37e84-668a-41ea-8904-4e362131c03e admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.517266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37e84-668a-41ea-8904-4e362131c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.517563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d37e84-668a-41ea-8904-4e362131c03e admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.518580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37e84-668a-41ea-8904-4e362131c03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.521120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d37e84-668a-41ea-8904-4e362131c03e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.552547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 964/1951] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:54.556183 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.571655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d910-1896-485c-a713-1a778aa08d76 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.632523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37323368-4f4f-4281-9054-208a99706cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.633281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37323368-4f4f-4281-9054-208a99706cea admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.633572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37323368-4f4f-4281-9054-208a99706cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.633853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37323368-4f4f-4281-9054-208a99706cea admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.634561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37323368-4f4f-4281-9054-208a99706cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.636783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37323368-4f4f-4281-9054-208a99706cea admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.657883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 988/1952] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:54.661932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37e84-668a-41ea-8904-4e362131c03e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.672296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d37e84-668a-41ea-8904-4e362131c03e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.677132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.677814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.678098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.678369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.679121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.680705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.691246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 965/1953] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:54.697214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37323368-4f4f-4281-9054-208a99706cea admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.705480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37323368-4f4f-4281-9054-208a99706cea admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.712413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebfdb4-b74b-48c3-bf65-09aa8d4decfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.712413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebfdb4-b74b-48c3-bf65-09aa8d4decfb admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.712413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebfdb4-b74b-48c3-bf65-09aa8d4decfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.712413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebfdb4-b74b-48c3-bf65-09aa8d4decfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.712747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebfdb4-b74b-48c3-bf65-09aa8d4decfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.713463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.714296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebfdb4-b74b-48c3-bf65-09aa8d4decfb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.715212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.725371 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 989/1954] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:54.729253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebfdb4-b74b-48c3-bf65-09aa8d4decfb admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.729752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6deb2-bfe8-46e5-aa66-30397b1ee0ca admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.737324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.738188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.738482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.738945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] PATH_INFO: `/v3/users/0f62ed8d573a4e7f8326cbbe98d89ee6` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.740111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f62ed8d573a4e7f8326cbbe98d89ee6)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.740285 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebfdb4-b74b-48c3-bf65-09aa8d4decfb admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.742265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.746390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ea4d4-a6a4-4234-aac8-c68db2209ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.747875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea4d4-a6a4-4234-aac8-c68db2209ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.748251 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea4d4-a6a4-4234-aac8-c68db2209ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.748626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea4d4-a6a4-4234-aac8-c68db2209ae7 admin admin] PATH_INFO: `/v3/projects/982e867b302a418b87f5f0c5e56d8d9a/users/7652038ec4724971aef2826cd1222d3c/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.765554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ea4d4-a6a4-4234-aac8-c68db2209ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982e867b302a418b87f5f0c5e56d8d9a, user_id=7652038ec4724971aef2826cd1222d3c, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.768269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ea4d4-a6a4-4234-aac8-c68db2209ae7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.783217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 990/1955] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:54 2022] PUT /identity/v3/projects/982e867b302a418b87f5f0c5e56d8d9a/users/7652038ec4724971aef2826cd1222d3c/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:54.792862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f62ed8d573a4e7f8326cbbe98d89ee6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.794520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b78bc-8692-45dc-b86b-d1fe71e9588d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.794816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b78bc-8692-45dc-b86b-d1fe71e9588d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.795276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b78bc-8692-45dc-b86b-d1fe71e9588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.797913 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f62ed8d573a4e7f8326cbbe98d89ee6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.805660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f62ed8d573a4e7f8326cbbe98d89ee6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.806395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f62ed8d573a4e7f8326cbbe98d89ee6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.817904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8a148d8a-7e6f-4843-b324-f5d43ff31759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f62ed8d573a4e7f8326cbbe98d89ee6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:54.822569 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8c7b78bc-8692-45dc-b86b-d1fe71e9588d None None] MFA Rules not processed for user `7652038ec4724971aef2826cd1222d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:54.823764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 966/1956] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:54 2022] DELETE /identity/v3/users/0f62ed8d573a4e7f8326cbbe98d89ee6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:54.827027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8c7b78bc-8692-45dc-b86b-d1fe71e9588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.828718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ace3-6792-48d2-9bdf-0b13a6b43ba5 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.829002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ace3-6792-48d2-9bdf-0b13a6b43ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.829280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9ace3-6792-48d2-9bdf-0b13a6b43ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.846520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e3b9ace3-6792-48d2-9bdf-0b13a6b43ba5 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:54.848415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e3b9ace3-6792-48d2-9bdf-0b13a6b43ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.892080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 991/1957] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:54.896095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b78bc-8692-45dc-b86b-d1fe71e9588d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.897405 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8c7b78bc-8692-45dc-b86b-d1fe71e9588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.910885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 967/1958] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:54.924065 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9ace3-6792-48d2-9bdf-0b13a6b43ba5 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.925617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e3b9ace3-6792-48d2-9bdf-0b13a6b43ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.962996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b78bc-8692-45dc-b86b-d1fe71e9588d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.967651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd465797-d768-45ee-a0d7-8e81e15da2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.968887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465797-d768-45ee-a0d7-8e81e15da2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.969170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465797-d768-45ee-a0d7-8e81e15da2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.969447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465797-d768-45ee-a0d7-8e81e15da2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.970137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd465797-d768-45ee-a0d7-8e81e15da2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.972083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd465797-d768-45ee-a0d7-8e81e15da2ff admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.981526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9ace3-6792-48d2-9bdf-0b13a6b43ba5 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.987693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd57fc-9b2d-44ce-b798-e5cac3e82148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.989072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd57fc-9b2d-44ce-b798-e5cac3e82148 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.989403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd57fc-9b2d-44ce-b798-e5cac3e82148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.989738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd57fc-9b2d-44ce-b798-e5cac3e82148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.003162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 992/1959] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:55.004099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd465797-d768-45ee-a0d7-8e81e15da2ff admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.008256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd57fc-9b2d-44ce-b798-e5cac3e82148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.013271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd57fc-9b2d-44ce-b798-e5cac3e82148 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.023999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 968/1960] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:55.077096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd465797-d768-45ee-a0d7-8e81e15da2ff admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:55.082415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7898d-0b2b-4b67-ad69-aa82f110e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:55.083128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7898d-0b2b-4b67-ad69-aa82f110e1bd admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.083409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7898d-0b2b-4b67-ad69-aa82f110e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.083682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7898d-0b2b-4b67-ad69-aa82f110e1bd admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.084374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7898d-0b2b-4b67-ad69-aa82f110e1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.086574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7898d-0b2b-4b67-ad69-aa82f110e1bd admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.108550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 993/1961] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:55 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:55.109804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd57fc-9b2d-44ce-b798-e5cac3e82148 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.119520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd57fc-9b2d-44ce-b798-e5cac3e82148 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:55.124788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae28ff-975b-4eb5-9de3-09a2a99a892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:55.125455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae28ff-975b-4eb5-9de3-09a2a99a892e admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.125740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae28ff-975b-4eb5-9de3-09a2a99a892e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.126045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae28ff-975b-4eb5-9de3-09a2a99a892e admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.126777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae28ff-975b-4eb5-9de3-09a2a99a892e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.128441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae28ff-975b-4eb5-9de3-09a2a99a892e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.139004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 969/1962] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:55.144526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7898d-0b2b-4b67-ad69-aa82f110e1bd admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.155415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7898d-0b2b-4b67-ad69-aa82f110e1bd admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:55.162143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a843a-5f59-4b9f-aee3-346609d75ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:55.163202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a843a-5f59-4b9f-aee3-346609d75ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.163557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a843a-5f59-4b9f-aee3-346609d75ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.164006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a843a-5f59-4b9f-aee3-346609d75ba1 admin admin] PATH_INFO: `/v3/projects/8cbca78eb28d45cdaebe02e9a13ad6d6/users/f97408a1880749288417a424a521fab0/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.182641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a843a-5f59-4b9f-aee3-346609d75ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbca78eb28d45cdaebe02e9a13ad6d6, user_id=f97408a1880749288417a424a521fab0, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.185142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a843a-5f59-4b9f-aee3-346609d75ba1 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.201916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 994/1963] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:55 2022] PUT /identity/v3/projects/8cbca78eb28d45cdaebe02e9a13ad6d6/users/f97408a1880749288417a424a521fab0/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:55.206549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae28ff-975b-4eb5-9de3-09a2a99a892e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.217188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae28ff-975b-4eb5-9de3-09a2a99a892e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:55.288433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762de3-0f61-4f10-8a28-d1387f7903c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:55.289162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762de3-0f61-4f10-8a28-d1387f7903c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.289453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762de3-0f61-4f10-8a28-d1387f7903c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.289732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762de3-0f61-4f10-8a28-d1387f7903c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.290468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f762de3-0f61-4f10-8a28-d1387f7903c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.292113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f762de3-0f61-4f10-8a28-d1387f7903c8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.302998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 970/1964] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:55.306790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a843a-5f59-4b9f-aee3-346609d75ba1 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.318752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a843a-5f59-4b9f-aee3-346609d75ba1 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:55.323820 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:55.324745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.325279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.325444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] PATH_INFO: `/v3/projects/8cbca78eb28d45cdaebe02e9a13ad6d6/users/f97408a1880749288417a424a521fab0/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.328787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbca78eb28d45cdaebe02e9a13ad6d6, user_id=f97408a1880749288417a424a521fab0, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.331872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.344497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 995/1965] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:55 2022] PUT /identity/v3/projects/8cbca78eb28d45cdaebe02e9a13ad6d6/users/f97408a1880749288417a424a521fab0/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:55.355135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8e62-e8b4-4cee-b4c5-edf5d6079760 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.355434 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8e62-e8b4-4cee-b4c5-edf5d6079760 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.355719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8e62-e8b4-4cee-b4c5-edf5d6079760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.384087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5a2b8e62-e8b4-4cee-b4c5-edf5d6079760 None None] MFA Rules not processed for user `f97408a1880749288417a424a521fab0`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:55.385317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5a2b8e62-e8b4-4cee-b4c5-edf5d6079760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:55.412792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.416120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:55.458649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 971/1966] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:55.471678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8e62-e8b4-4cee-b4c5-edf5d6079760 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.473203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5a2b8e62-e8b4-4cee-b4c5-edf5d6079760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:55.489611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fd361-be99-4ff7-a566-959dd7ef6044 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:55.494123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:55.495061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.495834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.496117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] PATH_INFO: `/v3/projects/7254cf7f2c4e4b5590bfaa9e19da3311` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.497476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7254cf7f2c4e4b5590bfaa9e19da3311)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.500083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.532228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8e62-e8b4-4cee-b4c5-edf5d6079760 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:55.535864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f7bfe-f23e-42e2-a840-8db3351ffd47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:55.536503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f7bfe-f23e-42e2-a840-8db3351ffd47 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.536784 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f7bfe-f23e-42e2-a840-8db3351ffd47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.537052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f7bfe-f23e-42e2-a840-8db3351ffd47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.546571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7254cf7f2c4e4b5590bfaa9e19da3311', 'request_id': 'req-792b7902-7843-4a28-9681-8b0aa16e6756'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.546722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f7bfe-f23e-42e2-a840-8db3351ffd47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.548178 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f7bfe-f23e-42e2-a840-8db3351ffd47 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.554502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7254cf7f2c4e4b5590bfaa9e19da3311', 'request_id': 'req-792b7902-7843-4a28-9681-8b0aa16e6756'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.559436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 972/1967] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:55.560282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7254cf7f2c4e4b5590bfaa9e19da3311', 'request_id': 'req-792b7902-7843-4a28-9681-8b0aa16e6756'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.573896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] The token cache is being invalidate because project 7254cf7f2c4e4b5590bfaa9e19da3311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:55.574184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.574864 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.576646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 996/1968] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:55 2022] DELETE /identity/v3/projects/7254cf7f2c4e4b5590bfaa9e19da3311 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:55.580411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f7bfe-f23e-42e2-a840-8db3351ffd47 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.591058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f7bfe-f23e-42e2-a840-8db3351ffd47 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:55.654293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:55.655211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.657369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.657760 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] PATH_INFO: `/v3/users/0ab6d8143fbc472c8d1017296b364981` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.659295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab6d8143fbc472c8d1017296b364981)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:55.661215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:55.729505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab6d8143fbc472c8d1017296b364981'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.737700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab6d8143fbc472c8d1017296b364981'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.748651 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab6d8143fbc472c8d1017296b364981'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.749326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab6d8143fbc472c8d1017296b364981'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.763601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab6d8143fbc472c8d1017296b364981'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:55.770322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 973/1969] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:55 2022] DELETE /identity/v3/users/0ab6d8143fbc472c8d1017296b364981 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:55.926281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:55.927705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:55.998314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b7902-7843-4a28-9681-8b0aa16e6756 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.060395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97408a1880749288417a424a521fab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbca78eb28d45cdaebe02e9a13ad6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.061163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.061603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.062093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.063378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:56.063819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.066137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.069636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.071227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:56.083133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 997/1970] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:45:56.084290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.087102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:56.105312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884c6d9-c603-4536-b54a-b76a79039745 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.118260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257245-9126-43d8-82f4-d8483a5cb0b3 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97408a1880749288417a424a521fab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbca78eb28d45cdaebe02e9a13ad6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.118945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257245-9126-43d8-82f4-d8483a5cb0b3 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.119262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257245-9126-43d8-82f4-d8483a5cb0b3 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.119547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257245-9126-43d8-82f4-d8483a5cb0b3 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.120250 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47257245-9126-43d8-82f4-d8483a5cb0b3 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.122436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47257245-9126-43d8-82f4-d8483a5cb0b3 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.172341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 998/1971] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:56 2022] POST /identity/v3/projects => generated 354 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:56.172698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c0855-304c-4313-9f1e-35ed1dec1e84 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.174695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257245-9126-43d8-82f4-d8483a5cb0b3 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.260175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.261274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.261619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.261929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] PATH_INFO: `/v3/projects/e4bc02c563ad449e98c0ae4b16500712` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.263504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4bc02c563ad449e98c0ae4b16500712)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.267049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.276933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257245-9126-43d8-82f4-d8483a5cb0b3 tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.285260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00dc642-07d3-48d1-ab72-a7fcf9a0421f tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97408a1880749288417a424a521fab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbca78eb28d45cdaebe02e9a13ad6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.297524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dc642-07d3-48d1-ab72-a7fcf9a0421f tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.300640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dc642-07d3-48d1-ab72-a7fcf9a0421f tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.301157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dc642-07d3-48d1-ab72-a7fcf9a0421f tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.301947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00dc642-07d3-48d1-ab72-a7fcf9a0421f tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:56.302255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00dc642-07d3-48d1-ab72-a7fcf9a0421f tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.303980 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00dc642-07d3-48d1-ab72-a7fcf9a0421f tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.332116 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4bc02c563ad449e98c0ae4b16500712', 'request_id': 'req-8bc04436-9d34-49df-b93f-e1c2439a3da3'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.332292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 999/1972] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:56.340511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4bc02c563ad449e98c0ae4b16500712', 'request_id': 'req-8bc04436-9d34-49df-b93f-e1c2439a3da3'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.348393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4bc02c563ad449e98c0ae4b16500712', 'request_id': 'req-8bc04436-9d34-49df-b93f-e1c2439a3da3'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.368728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] The token cache is being invalidate because project e4bc02c563ad449e98c0ae4b16500712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:56.369517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.375248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.375248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 974/1973] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:56 2022] DELETE /identity/v3/projects/e4bc02c563ad449e98c0ae4b16500712 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:56.376818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.377520 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968f42-c2c6-459c-8c36-048640e97376 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.377992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968f42-c2c6-459c-8c36-048640e97376 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.378322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:56.378848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968f42-c2c6-459c-8c36-048640e97376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.438667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-75968f42-c2c6-459c-8c36-048640e97376 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:56.439924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-75968f42-c2c6-459c-8c36-048640e97376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:56.504872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc04436-9d34-49df-b93f-e1c2439a3da3 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.513482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97408a1880749288417a424a521fab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbca78eb28d45cdaebe02e9a13ad6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.514419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.515332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.515613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] PATH_INFO: `/v3/projects/10152c88e16f4a309288c131371c27a8` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.517185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10152c88e16f4a309288c131371c27a8)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.519904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.578785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1000/1974] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:56.592034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511720d-c0e6-4f16-bd4e-d67b98829195 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.592339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511720d-c0e6-4f16-bd4e-d67b98829195 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.592889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511720d-c0e6-4f16-bd4e-d67b98829195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.593990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10152c88e16f4a309288c131371c27a8', 'request_id': 'req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.604652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10152c88e16f4a309288c131371c27a8', 'request_id': 'req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.615636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10152c88e16f4a309288c131371c27a8', 'request_id': 'req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.630483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d511720d-c0e6-4f16-bd4e-d67b98829195 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:56.632233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d511720d-c0e6-4f16-bd4e-d67b98829195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:56.634431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] The token cache is being invalidate because project 10152c88e16f4a309288c131371c27a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:56.635293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.636384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:56.639764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 975/1975] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:56 2022] DELETE /identity/v3/projects/10152c88e16f4a309288c131371c27a8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:56.724286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1001/1976] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:56.731625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.750402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ea7cb-d12d-430b-b05c-cc5cf455373c tempest-VolumeQuotaClassesTest-1747589997 tempest-VolumeQuotaClassesTest-1747589997-project-admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.758818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.759613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.759947 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.760324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.762124 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:56.762561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.764489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.779557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 976/1977] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:45:56.788089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511720d-c0e6-4f16-bd4e-d67b98829195 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.797732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511720d-c0e6-4f16-bd4e-d67b98829195 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.803000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.803660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.803951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.804214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.805105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.807230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.845313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1002/1978] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:56 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:56.849859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.861186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d997a-9f17-4497-90cc-d4b1bb217c6e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.920734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.923229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:56.929217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de3b90-6226-40fd-b24d-4b9a08c595e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.930205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3b90-6226-40fd-b24d-4b9a08c595e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.930205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3b90-6226-40fd-b24d-4b9a08c595e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.930513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3b90-6226-40fd-b24d-4b9a08c595e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.931371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de3b90-6226-40fd-b24d-4b9a08c595e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.933364 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de3b90-6226-40fd-b24d-4b9a08c595e9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.937919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541b52a-4e28-41ce-8fc7-e355d0e41343 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.942890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.943808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.944091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.944402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] PATH_INFO: `/v3/users/7652038ec4724971aef2826cd1222d3c` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.946364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7652038ec4724971aef2826cd1222d3c)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.948416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.958755 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 977/1979] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:56 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:56.960050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de3b90-6226-40fd-b24d-4b9a08c595e9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.970944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de3b90-6226-40fd-b24d-4b9a08c595e9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.976871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619177f5-9971-496d-b6d7-03ca4bb3a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.977584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619177f5-9971-496d-b6d7-03ca4bb3a8bc admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.977870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619177f5-9971-496d-b6d7-03ca4bb3a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.978275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619177f5-9971-496d-b6d7-03ca4bb3a8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.979072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619177f5-9971-496d-b6d7-03ca4bb3a8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.980973 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619177f5-9971-496d-b6d7-03ca4bb3a8bc admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.995430 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 978/1980] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:56.998262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619177f5-9971-496d-b6d7-03ca4bb3a8bc admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.005027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7652038ec4724971aef2826cd1222d3c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.012438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619177f5-9971-496d-b6d7-03ca4bb3a8bc admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.017105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7652038ec4724971aef2826cd1222d3c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.023365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.024067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.024379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.024627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.025426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.026524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7652038ec4724971aef2826cd1222d3c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.027205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.027558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7652038ec4724971aef2826cd1222d3c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.038995 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 979/1981] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:57.043179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.043324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-17e90b97-632f-4823-879c-f1f7456c3f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7652038ec4724971aef2826cd1222d3c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.045571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.051787 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1003/1982] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:56 2022] DELETE /identity/v3/users/7652038ec4724971aef2826cd1222d3c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:57.055997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a1fc-41b5-4976-b8b0-f832d746f10b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.056531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a1fc-41b5-4976-b8b0-f832d746f10b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.056880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29a1fc-41b5-4976-b8b0-f832d746f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.060442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938f12b-61d4-4d99-9181-1f8780a9ca76 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.080363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1c29a1fc-41b5-4976-b8b0-f832d746f10b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:57.081755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1c29a1fc-41b5-4976-b8b0-f832d746f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.127363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae60ff2-1fe6-4a7b-a462-c7e745772dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.128259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60ff2-1fe6-4a7b-a462-c7e745772dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.128541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60ff2-1fe6-4a7b-a462-c7e745772dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.128825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60ff2-1fe6-4a7b-a462-c7e745772dbc admin admin] PATH_INFO: `/v3/projects/d583264fee0048f386cbf3281191a9a8/users/d1b0a6f5fedf44f3abb03a70e0850974/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.144207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae60ff2-1fe6-4a7b-a462-c7e745772dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d583264fee0048f386cbf3281191a9a8, user_id=d1b0a6f5fedf44f3abb03a70e0850974, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.146875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae60ff2-1fe6-4a7b-a462-c7e745772dbc admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.147396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1004/1983] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:57.156601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a1fc-41b5-4976-b8b0-f832d746f10b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.157933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1c29a1fc-41b5-4976-b8b0-f832d746f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.160650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 980/1984] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:57 2022] PUT /identity/v3/projects/d583264fee0048f386cbf3281191a9a8/users/d1b0a6f5fedf44f3abb03a70e0850974/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:57.171611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f716f-904e-4692-bd5f-53cabeb67321 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.171895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f716f-904e-4692-bd5f-53cabeb67321 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.172168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f716f-904e-4692-bd5f-53cabeb67321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.204780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-663f716f-904e-4692-bd5f-53cabeb67321 None None] MFA Rules not processed for user `d1b0a6f5fedf44f3abb03a70e0850974`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:57.206040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-663f716f-904e-4692-bd5f-53cabeb67321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.228993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29a1fc-41b5-4976-b8b0-f832d746f10b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.276431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 981/1985] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:57.281242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f716f-904e-4692-bd5f-53cabeb67321 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.281749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0220a7-49cd-4ff5-86a1-42846a061cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.282465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0220a7-49cd-4ff5-86a1-42846a061cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.282855 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0220a7-49cd-4ff5-86a1-42846a061cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.283164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0220a7-49cd-4ff5-86a1-42846a061cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.344748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f716f-904e-4692-bd5f-53cabeb67321 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.349427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fd79d-3807-4294-b2d9-61eb379788fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.350163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fd79d-3807-4294-b2d9-61eb379788fc admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.350602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fd79d-3807-4294-b2d9-61eb379788fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.350875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0220a7-49cd-4ff5-86a1-42846a061cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.351370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fd79d-3807-4294-b2d9-61eb379788fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.351838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fd79d-3807-4294-b2d9-61eb379788fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.352824 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0220a7-49cd-4ff5-86a1-42846a061cd3 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.355117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fd79d-3807-4294-b2d9-61eb379788fc admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.364447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1005/1986] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:57.383237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 982/1987] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:57 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:57.387031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0220a7-49cd-4ff5-86a1-42846a061cd3 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.397230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0220a7-49cd-4ff5-86a1-42846a061cd3 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.463342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c43be-5d28-4310-9161-371882639da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.464046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c43be-5d28-4310-9161-371882639da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.464393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c43be-5d28-4310-9161-371882639da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.464745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c43be-5d28-4310-9161-371882639da3 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.465438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c43be-5d28-4310-9161-371882639da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.467360 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c43be-5d28-4310-9161-371882639da3 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.497444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fd79d-3807-4294-b2d9-61eb379788fc admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.503433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1006/1988] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:57 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:57.513066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fd79d-3807-4294-b2d9-61eb379788fc admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.533511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f868c-9e74-4552-ba2d-b064d4422887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.534458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f868c-9e74-4552-ba2d-b064d4422887 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.534738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f868c-9e74-4552-ba2d-b064d4422887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.535175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f868c-9e74-4552-ba2d-b064d4422887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.535888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f868c-9e74-4552-ba2d-b064d4422887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.537556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f868c-9e74-4552-ba2d-b064d4422887 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.550156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 983/1989] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:57.554286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c43be-5d28-4310-9161-371882639da3 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.564609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c43be-5d28-4310-9161-371882639da3 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.570194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc4516-882e-4f02-8b81-45a23855032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.570863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4516-882e-4f02-8b81-45a23855032a admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.571205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4516-882e-4f02-8b81-45a23855032a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.571593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4516-882e-4f02-8b81-45a23855032a admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.572433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc4516-882e-4f02-8b81-45a23855032a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.574332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc4516-882e-4f02-8b81-45a23855032a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.587111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1007/1990] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:57.589277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f868c-9e74-4552-ba2d-b064d4422887 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.609720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f868c-9e74-4552-ba2d-b064d4422887 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.609720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.609720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.609720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.610500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] PATH_INFO: `/v3/projects/2a335b5a63254cbba42507555e293464/users/8122e3991c574336bb2f55db673a4685/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.622150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a335b5a63254cbba42507555e293464, user_id=8122e3991c574336bb2f55db673a4685, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.624915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.637933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 984/1991] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:57 2022] PUT /identity/v3/projects/2a335b5a63254cbba42507555e293464/users/8122e3991c574336bb2f55db673a4685/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:57.649454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bf1f-3bd9-4592-9c0a-10addf9f8f61 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.649745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bf1f-3bd9-4592-9c0a-10addf9f8f61 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.650024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848bf1f-3bd9-4592-9c0a-10addf9f8f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.674134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.677071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.679102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b848bf1f-3bd9-4592-9c0a-10addf9f8f61 None None] MFA Rules not processed for user `8122e3991c574336bb2f55db673a4685`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:57.680347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b848bf1f-3bd9-4592-9c0a-10addf9f8f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.750807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1008/1992] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:57.751664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848bf1f-3bd9-4592-9c0a-10addf9f8f61 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.752928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b848bf1f-3bd9-4592-9c0a-10addf9f8f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.762042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a768ee-58a8-4236-ac76-c489ee8ea31e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.766020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848bf1f-3bd9-4592-9c0a-10addf9f8f61 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.767104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.767977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.768252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.768520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] PATH_INFO: `/v3/projects/982e867b302a418b87f5f0c5e56d8d9a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.769677 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=982e867b302a418b87f5f0c5e56d8d9a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.770535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.771425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.771607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.771705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.771959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] PATH_INFO: `/v3/users/21cb655e726a40fe97da80604b718e2a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.773144 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21cb655e726a40fe97da80604b718e2a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.775048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.817308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982e867b302a418b87f5f0c5e56d8d9a', 'request_id': 'req-e3242c54-c978-40fd-8eee-185aab7c6ce0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.822340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21cb655e726a40fe97da80604b718e2a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.824775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982e867b302a418b87f5f0c5e56d8d9a', 'request_id': 'req-e3242c54-c978-40fd-8eee-185aab7c6ce0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.831576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21cb655e726a40fe97da80604b718e2a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.831694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982e867b302a418b87f5f0c5e56d8d9a', 'request_id': 'req-e3242c54-c978-40fd-8eee-185aab7c6ce0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.843810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] The token cache is being invalidate because project 982e867b302a418b87f5f0c5e56d8d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:57.843948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21cb655e726a40fe97da80604b718e2a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.844146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.844631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21cb655e726a40fe97da80604b718e2a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.844820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.846605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 985/1993] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:57 2022] DELETE /identity/v3/projects/982e867b302a418b87f5f0c5e56d8d9a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:57.847255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.848471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.859101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21cb655e726a40fe97da80604b718e2a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.864925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1009/1994] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:57 2022] DELETE /identity/v3/users/21cb655e726a40fe97da80604b718e2a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:57.865763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:57.867116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:57.912089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242c54-c978-40fd-8eee-185aab7c6ce0 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.929006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1d43e-2a0b-4603-9fb1-bc7fe630c24c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:57.933617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.934507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.934771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.935073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] PATH_INFO: `/v3/users/f97408a1880749288417a424a521fab0` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.936266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97408a1880749288417a424a521fab0)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.938207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.965480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503dc42-e32f-4cf9-9d8b-26e2a831fd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:57.966144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503dc42-e32f-4cf9-9d8b-26e2a831fd55 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.966425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503dc42-e32f-4cf9-9d8b-26e2a831fd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.966699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503dc42-e32f-4cf9-9d8b-26e2a831fd55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:57.967436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503dc42-e32f-4cf9-9d8b-26e2a831fd55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:57.969927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503dc42-e32f-4cf9-9d8b-26e2a831fd55 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:57.984595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97408a1880749288417a424a521fab0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.991462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97408a1880749288417a424a521fab0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:57.994075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 986/1995] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:57 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:57.995581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af7f38-fc10-4673-9ab3-e93f8a347040 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:57.995866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af7f38-fc10-4673-9ab3-e93f8a347040 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:57.996205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af7f38-fc10-4673-9ab3-e93f8a347040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.000939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97408a1880749288417a424a521fab0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.001574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97408a1880749288417a424a521fab0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.013492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97408a1880749288417a424a521fab0'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.013634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-f0af7f38-fc10-4673-9ab3-e93f8a347040 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:58.015315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f0af7f38-fc10-4673-9ab3-e93f8a347040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.020357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1010/1996] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:57 2022] DELETE /identity/v3/users/f97408a1880749288417a424a521fab0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:58.020812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.034498 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.078747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 987/1997] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:58.093515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af7f38-fc10-4673-9ab3-e93f8a347040 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.095310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f0af7f38-fc10-4673-9ab3-e93f8a347040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.143011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a033f16-3ef4-40dd-ac52-1fab86cd2f81 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.149309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eedd9-77ab-42a6-a2e1-fd1adcddc7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.149780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eedd9-77ab-42a6-a2e1-fd1adcddc7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.150066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eedd9-77ab-42a6-a2e1-fd1adcddc7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.150346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eedd9-77ab-42a6-a2e1-fd1adcddc7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.151097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eedd9-77ab-42a6-a2e1-fd1adcddc7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.153053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eedd9-77ab-42a6-a2e1-fd1adcddc7d3 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.173919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af7f38-fc10-4673-9ab3-e93f8a347040 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.179481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1011/1998] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:58 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:58.183317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eedd9-77ab-42a6-a2e1-fd1adcddc7d3 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.198926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eedd9-77ab-42a6-a2e1-fd1adcddc7d3 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.208725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d3451-e4f9-49ed-90c2-656693e3dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.208725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d3451-e4f9-49ed-90c2-656693e3dd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.208725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d3451-e4f9-49ed-90c2-656693e3dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.208725 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d3451-e4f9-49ed-90c2-656693e3dd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.209192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d3451-e4f9-49ed-90c2-656693e3dd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.211393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d3451-e4f9-49ed-90c2-656693e3dd41 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.227221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1012/1999] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:58.228134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d3451-e4f9-49ed-90c2-656693e3dd41 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.239765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d3451-e4f9-49ed-90c2-656693e3dd41 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.262289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324a2a8-66f9-47dc-a2fe-29a33b095f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.263606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324a2a8-66f9-47dc-a2fe-29a33b095f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.263891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324a2a8-66f9-47dc-a2fe-29a33b095f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.264317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324a2a8-66f9-47dc-a2fe-29a33b095f72 admin admin] PATH_INFO: `/v3/projects/901846c755ed41bea2103455f66c1661/users/3f77a15672ce4d96a08d73452aaa45a7/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.269681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f354d7-c08f-4493-94f9-9fc56723b6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.270348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f354d7-c08f-4493-94f9-9fc56723b6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.271182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f354d7-c08f-4493-94f9-9fc56723b6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.271464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f354d7-c08f-4493-94f9-9fc56723b6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.283256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324a2a8-66f9-47dc-a2fe-29a33b095f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901846c755ed41bea2103455f66c1661, user_id=3f77a15672ce4d96a08d73452aaa45a7, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.286043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324a2a8-66f9-47dc-a2fe-29a33b095f72 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.286644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f354d7-c08f-4493-94f9-9fc56723b6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.293026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f354d7-c08f-4493-94f9-9fc56723b6a8 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.303410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1013/2000] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:58 2022] PUT /identity/v3/projects/901846c755ed41bea2103455f66c1661/users/3f77a15672ce4d96a08d73452aaa45a7/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:58.304432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324a2a8-66f9-47dc-a2fe-29a33b095f72 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.317075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 988/2001] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:58.366352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324a2a8-66f9-47dc-a2fe-29a33b095f72 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.372733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.373806 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.374532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.375077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.376341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.378411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.390887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1014/2002] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:58.395316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f354d7-c08f-4493-94f9-9fc56723b6a8 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.403181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.406739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.407738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f354d7-c08f-4493-94f9-9fc56723b6a8 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.413795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21a089-b186-4857-8dda-d1efa00fcc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.414838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21a089-b186-4857-8dda-d1efa00fcc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.415484 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21a089-b186-4857-8dda-d1efa00fcc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.415735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21a089-b186-4857-8dda-d1efa00fcc2f admin admin] PATH_INFO: `/v3/projects/901846c755ed41bea2103455f66c1661/users/3f77a15672ce4d96a08d73452aaa45a7/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.433340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a766d-1da5-470a-9f99-5f0e47ee57a8 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.440556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.441624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.442047 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.442369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] PATH_INFO: `/v3/projects/8cbca78eb28d45cdaebe02e9a13ad6d6` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.442936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21a089-b186-4857-8dda-d1efa00fcc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=901846c755ed41bea2103455f66c1661, user_id=3f77a15672ce4d96a08d73452aaa45a7, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.444228 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cbca78eb28d45cdaebe02e9a13ad6d6)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.445816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21a089-b186-4857-8dda-d1efa00fcc2f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.446149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.461225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 989/2003] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:58 2022] PUT /identity/v3/projects/901846c755ed41bea2103455f66c1661/users/3f77a15672ce4d96a08d73452aaa45a7/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:58.473700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55867a7b-d103-4a16-ba97-843356e0af63 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.474050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55867a7b-d103-4a16-ba97-843356e0af63 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.474255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55867a7b-d103-4a16-ba97-843356e0af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.507340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-55867a7b-d103-4a16-ba97-843356e0af63 None None] MFA Rules not processed for user `3f77a15672ce4d96a08d73452aaa45a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:58.508547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-55867a7b-d103-4a16-ba97-843356e0af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.539259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbca78eb28d45cdaebe02e9a13ad6d6', 'request_id': 'req-35d8432f-35e2-4c27-9e7f-90ea879872ff'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.568233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbca78eb28d45cdaebe02e9a13ad6d6', 'request_id': 'req-35d8432f-35e2-4c27-9e7f-90ea879872ff'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.576805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbca78eb28d45cdaebe02e9a13ad6d6', 'request_id': 'req-35d8432f-35e2-4c27-9e7f-90ea879872ff'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.590425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] The token cache is being invalidate because project 8cbca78eb28d45cdaebe02e9a13ad6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:58.591069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.591974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-35d8432f-35e2-4c27-9e7f-90ea879872ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.594129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1015/2004] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:58 2022] DELETE /identity/v3/projects/8cbca78eb28d45cdaebe02e9a13ad6d6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:58.598932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5673a0e-8bfa-4bbd-966c-a908fa432aa4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.599268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5673a0e-8bfa-4bbd-966c-a908fa432aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.599522 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5673a0e-8bfa-4bbd-966c-a908fa432aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.607109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 990/2005] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:58.618262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55867a7b-d103-4a16-ba97-843356e0af63 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.619856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-55867a7b-d103-4a16-ba97-843356e0af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.628157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b5673a0e-8bfa-4bbd-966c-a908fa432aa4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:58.629532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b5673a0e-8bfa-4bbd-966c-a908fa432aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.703752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55867a7b-d103-4a16-ba97-843356e0af63 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.709452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc86aa-a0d5-40a3-82da-ed2fceb777e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.710358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc86aa-a0d5-40a3-82da-ed2fceb777e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.710701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc86aa-a0d5-40a3-82da-ed2fceb777e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.711093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc86aa-a0d5-40a3-82da-ed2fceb777e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.713034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e5cc86aa-a0d5-40a3-82da-ed2fceb777e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.722776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1016/2006] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:45:58.723437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5673a0e-8bfa-4bbd-966c-a908fa432aa4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.724679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b5673a0e-8bfa-4bbd-966c-a908fa432aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.738848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5673a0e-8bfa-4bbd-966c-a908fa432aa4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.743649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.744510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.744793 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.745069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] PATH_INFO: `/v3/projects/8e6e046b9f1c41fa8d08969f7012b946` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.746248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6e046b9f1c41fa8d08969f7012b946)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.748186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.784999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc86aa-a0d5-40a3-82da-ed2fceb777e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.786834 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc86aa-a0d5-40a3-82da-ed2fceb777e3 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.798484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6e046b9f1c41fa8d08969f7012b946', 'request_id': 'req-260f0a89-e76d-48b9-921c-fc48febe8a75'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.799121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 991/2007] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:45:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:45:58.800618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a02bb-7d0e-4414-ba48-fb190916b7bf None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.800969 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a02bb-7d0e-4414-ba48-fb190916b7bf None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.801337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a02bb-7d0e-4414-ba48-fb190916b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.817235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6e046b9f1c41fa8d08969f7012b946', 'request_id': 'req-260f0a89-e76d-48b9-921c-fc48febe8a75'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.821324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-4a8a02bb-7d0e-4414-ba48-fb190916b7bf None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:58.822532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4a8a02bb-7d0e-4414-ba48-fb190916b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.827990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6e046b9f1c41fa8d08969f7012b946', 'request_id': 'req-260f0a89-e76d-48b9-921c-fc48febe8a75'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.841552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] The token cache is being invalidate because project 8e6e046b9f1c41fa8d08969f7012b946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:58.841990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.843513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:58.846052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1017/2008] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:58 2022] DELETE /identity/v3/projects/8e6e046b9f1c41fa8d08969f7012b946 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:58.850606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.852236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.907960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 992/2009] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:58.912447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a02bb-7d0e-4414-ba48-fb190916b7bf None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.922640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a02bb-7d0e-4414-ba48-fb190916b7bf None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.928859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.929529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.929802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.930073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.931093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:45:58.931203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.932726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.937037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f0a89-e76d-48b9-921c-fc48febe8a75 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.942920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.943889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.944171 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.944445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] PATH_INFO: `/v3/users/be303d707d40487d9a2a4a10e25de120` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.945669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be303d707d40487d9a2a4a10e25de120)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.947634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.952114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 993/2010] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:45:58.953294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.968246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bb11-17de-4f33-9f56-4a176d53bf44 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.976323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.977406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.977733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.978041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.978940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.981806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.004268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be303d707d40487d9a2a4a10e25de120'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.011925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be303d707d40487d9a2a4a10e25de120'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.020902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be303d707d40487d9a2a4a10e25de120'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.021646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be303d707d40487d9a2a4a10e25de120'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.022817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 994/2011] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:58 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:59.027425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.029808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:59.041559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be303d707d40487d9a2a4a10e25de120'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.049879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1018/2012] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:58 2022] DELETE /identity/v3/users/be303d707d40487d9a2a4a10e25de120 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:59.138149 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959c561-64cd-4577-9999-1606495db701 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.214829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb6554-a635-4422-b19c-e41309d9dc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.215593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6554-a635-4422-b19c-e41309d9dc53 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.215881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6554-a635-4422-b19c-e41309d9dc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.216159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6554-a635-4422-b19c-e41309d9dc53 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.216984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb6554-a635-4422-b19c-e41309d9dc53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.219243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb6554-a635-4422-b19c-e41309d9dc53 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.244730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 995/2013] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:59 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:59.248628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.265892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eebecb-9441-49eb-9714-e104f62e0515 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.271649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b38595-1d22-41b7-83c0-8c1d3c8534a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.272505 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b38595-1d22-41b7-83c0-8c1d3c8534a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.272676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b38595-1d22-41b7-83c0-8c1d3c8534a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.273061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b38595-1d22-41b7-83c0-8c1d3c8534a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.274652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b38595-1d22-41b7-83c0-8c1d3c8534a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.276352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b38595-1d22-41b7-83c0-8c1d3c8534a8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.294314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1019/2014] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:59.294775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb6554-a635-4422-b19c-e41309d9dc53 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.310243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb6554-a635-4422-b19c-e41309d9dc53 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.320641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310f04-6687-4af3-890e-5d95c6f0c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.321616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310f04-6687-4af3-890e-5d95c6f0c2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.322919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310f04-6687-4af3-890e-5d95c6f0c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.325027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310f04-6687-4af3-890e-5d95c6f0c2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.326126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb310f04-6687-4af3-890e-5d95c6f0c2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.330646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb310f04-6687-4af3-890e-5d95c6f0c2c5 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.342316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 996/2015] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:45:59.346337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b38595-1d22-41b7-83c0-8c1d3c8534a8 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.357636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b38595-1d22-41b7-83c0-8c1d3c8534a8 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.363927 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.364826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.365106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.365653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] PATH_INFO: `/v3/projects/802e3083643a437881a018696e4d937e/users/70151022737d4bf5a95f42e5e24f0151/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.383012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=802e3083643a437881a018696e4d937e, user_id=70151022737d4bf5a95f42e5e24f0151, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.385915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.400182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1020/2016] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:59 2022] PUT /identity/v3/projects/802e3083643a437881a018696e4d937e/users/70151022737d4bf5a95f42e5e24f0151/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:45:59.412589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35cdb-aaad-4fab-9775-6e4c3af556b4 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.412878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35cdb-aaad-4fab-9775-6e4c3af556b4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.413163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35cdb-aaad-4fab-9775-6e4c3af556b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.424920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.428483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:59.457842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d7c35cdb-aaad-4fab-9775-6e4c3af556b4 None None] MFA Rules not processed for user `70151022737d4bf5a95f42e5e24f0151`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:59.459137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d7c35cdb-aaad-4fab-9775-6e4c3af556b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:59.519848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8abaf-4582-47f8-999c-52ecf4441e9e admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.525647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.527157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.527438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.527708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] PATH_INFO: `/v3/projects/b1e2bcbf651b49c9b494dd259a32c5aa` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.529045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e2bcbf651b49c9b494dd259a32c5aa)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.531055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.531958 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 997/2017] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:45:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:59.536366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35cdb-aaad-4fab-9775-6e4c3af556b4 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.547649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35cdb-aaad-4fab-9775-6e4c3af556b4 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.552556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f65dc-dd9f-4072-a49e-53b85c20403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.553260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f65dc-dd9f-4072-a49e-53b85c20403c admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.553548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f65dc-dd9f-4072-a49e-53b85c20403c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.553821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f65dc-dd9f-4072-a49e-53b85c20403c admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.554525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f65dc-dd9f-4072-a49e-53b85c20403c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.556524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f65dc-dd9f-4072-a49e-53b85c20403c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.584674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e2bcbf651b49c9b494dd259a32c5aa', 'request_id': 'req-27d8ed25-ce46-4085-a4de-d7418b1d7d94'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.589013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 998/2018] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:45:59 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:45:59.593244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f65dc-dd9f-4072-a49e-53b85c20403c admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.596663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e2bcbf651b49c9b494dd259a32c5aa', 'request_id': 'req-27d8ed25-ce46-4085-a4de-d7418b1d7d94'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.606365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e2bcbf651b49c9b494dd259a32c5aa', 'request_id': 'req-27d8ed25-ce46-4085-a4de-d7418b1d7d94'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.618095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] The token cache is being invalidate because project b1e2bcbf651b49c9b494dd259a32c5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:45:59.618460 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.619763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.621577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1021/2019] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:45:59 2022] DELETE /identity/v3/projects/b1e2bcbf651b49c9b494dd259a32c5aa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:59.626038 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.627523 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:59.669315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f65dc-dd9f-4072-a49e-53b85c20403c admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.675203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.676177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.676463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.676871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.677727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.679738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.701601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 999/2020] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:45:59 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:45:59.706178 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.710440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:59.711352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ed25-ce46-4085-a4de-d7418b1d7d94 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.716549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.717710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.718099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.718536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] PATH_INFO: `/v3/users/6cae3a9e0d0b4083b94fd4797121f16c` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.720156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cae3a9e0d0b4083b94fd4797121f16c)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.722203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.725726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a347a-bbac-4e6e-aec1-1b2d18d0f791 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.731879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e26d08-bd75-4ecb-9bc6-a4598f04e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.732677 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e26d08-bd75-4ecb-9bc6-a4598f04e988 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.732959 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e26d08-bd75-4ecb-9bc6-a4598f04e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.733238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e26d08-bd75-4ecb-9bc6-a4598f04e988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.734009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e26d08-bd75-4ecb-9bc6-a4598f04e988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.736487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e26d08-bd75-4ecb-9bc6-a4598f04e988 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.754852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1000/2021] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:59.758156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e26d08-bd75-4ecb-9bc6-a4598f04e988 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.773611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e26d08-bd75-4ecb-9bc6-a4598f04e988 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.778809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.779782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.780062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.780363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] PATH_INFO: `/v3/projects/10eb1b0b373d4fceb7b7209b87314ee2/users/33655d10fd104b3b9466c6a87387419c/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.787917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cae3a9e0d0b4083b94fd4797121f16c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.794501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cae3a9e0d0b4083b94fd4797121f16c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.795162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10eb1b0b373d4fceb7b7209b87314ee2, user_id=33655d10fd104b3b9466c6a87387419c, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.798062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.802273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cae3a9e0d0b4083b94fd4797121f16c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.803070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cae3a9e0d0b4083b94fd4797121f16c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.815364 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1001/2022] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:59 2022] PUT /identity/v3/projects/10eb1b0b373d4fceb7b7209b87314ee2/users/33655d10fd104b3b9466c6a87387419c/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:59.817015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cae3a9e0d0b4083b94fd4797121f16c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:45:59.819319 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.820898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:59.829890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1022/2023] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:45:59 2022] DELETE /identity/v3/users/6cae3a9e0d0b4083b94fd4797121f16c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:59.892881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7496e90-a56a-4793-a880-d534d52a4f6f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.956693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24c574-af8d-47c1-a57e-c7ff9f3c7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.957388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24c574-af8d-47c1-a57e-c7ff9f3c7adf admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.957663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24c574-af8d-47c1-a57e-c7ff9f3c7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.957989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24c574-af8d-47c1-a57e-c7ff9f3c7adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.958723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24c574-af8d-47c1-a57e-c7ff9f3c7adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:59.960463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24c574-af8d-47c1-a57e-c7ff9f3c7adf admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:59.971456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1002/2024] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:45:59.975887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:59.987921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076bb61-68fe-4faf-b48e-541f5b1d01be admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:59.993066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:59.994312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:59.994673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:59.995089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] PATH_INFO: `/v3/projects/10eb1b0b373d4fceb7b7209b87314ee2/users/33655d10fd104b3b9466c6a87387419c/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:59.997967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10eb1b0b373d4fceb7b7209b87314ee2, user_id=33655d10fd104b3b9466c6a87387419c, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:00.017077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:00.035372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1023/2025] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:45:59 2022] PUT /identity/v3/projects/10eb1b0b373d4fceb7b7209b87314ee2/users/33655d10fd104b3b9466c6a87387419c/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:00.045604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c321a-ef7e-442a-8beb-7a5cadf8ac55 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.046433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c321a-ef7e-442a-8beb-7a5cadf8ac55 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.046721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c321a-ef7e-442a-8beb-7a5cadf8ac55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.075433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-217c321a-ef7e-442a-8beb-7a5cadf8ac55 None None] MFA Rules not processed for user `33655d10fd104b3b9466c6a87387419c`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:00.077174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-217c321a-ef7e-442a-8beb-7a5cadf8ac55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:00.151470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1003/2026] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:00.165137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:00.167424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:00.188989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c321a-ef7e-442a-8beb-7a5cadf8ac55 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:00.190597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-217c321a-ef7e-442a-8beb-7a5cadf8ac55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:00.260386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd372b-e741-4fca-a157-9d9dae52b74a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:00.265765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4f399-0979-474a-a2c0-015d72979992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:00.266657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f399-0979-474a-a2c0-015d72979992 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.267069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f399-0979-474a-a2c0-015d72979992 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.267422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f399-0979-474a-a2c0-015d72979992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.270011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-71e4f399-0979-474a-a2c0-015d72979992 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:00.276252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c321a-ef7e-442a-8beb-7a5cadf8ac55 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:00.286493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:00.287969 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.288256 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.288532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] PATH_INFO: `/v3/projects/853083d37bf34b3eacb0ae49fd39a355` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.289783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853083d37bf34b3eacb0ae49fd39a355)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:00.292083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:00.352935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853083d37bf34b3eacb0ae49fd39a355', 'request_id': 'req-b6df499b-3016-42b8-b656-d5391cdd9ee3'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:00.353483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4f399-0979-474a-a2c0-015d72979992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:00.354941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4f399-0979-474a-a2c0-015d72979992 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:00.362095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853083d37bf34b3eacb0ae49fd39a355', 'request_id': 'req-b6df499b-3016-42b8-b656-d5391cdd9ee3'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:00.366883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1024/2027] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:00.370148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853083d37bf34b3eacb0ae49fd39a355', 'request_id': 'req-b6df499b-3016-42b8-b656-d5391cdd9ee3'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:00.381811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] The token cache is being invalidate because project 853083d37bf34b3eacb0ae49fd39a355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:00.382102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:00.382906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b6df499b-3016-42b8-b656-d5391cdd9ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:00.384578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1004/2028] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:00 2022] DELETE /identity/v3/projects/853083d37bf34b3eacb0ae49fd39a355 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:00.389553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985563-1458-4919-9737-098078ecb677 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.390074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985563-1458-4919-9737-098078ecb677 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.390179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985563-1458-4919-9737-098078ecb677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.416412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-eb985563-1458-4919-9737-098078ecb677 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:00.416586 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-eb985563-1458-4919-9737-098078ecb677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:00.498754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1025/2029] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:00.506644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc9d2-ea56-4ee2-bc80-ad2c561d951b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.506934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc9d2-ea56-4ee2-bc80-ad2c561d951b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.507254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc9d2-ea56-4ee2-bc80-ad2c561d951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.532867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-68ffc9d2-ea56-4ee2-bc80-ad2c561d951b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:00.534640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-68ffc9d2-ea56-4ee2-bc80-ad2c561d951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:00.546809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1005/2030] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:00.550890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985563-1458-4919-9737-098078ecb677 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:00.564238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985563-1458-4919-9737-098078ecb677 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:00.570570 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:00.571707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.572714 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.572838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.573646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:00.575089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:00.577219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:00.599160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1026/2031] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:00.603862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc9d2-ea56-4ee2-bc80-ad2c561d951b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:00.616906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc9d2-ea56-4ee2-bc80-ad2c561d951b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:00.623911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b967d-ca38-40be-84a2-cb3ecd7854ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:00.625433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b967d-ca38-40be-84a2-cb3ecd7854ea admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.625986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b967d-ca38-40be-84a2-cb3ecd7854ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.626483 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b967d-ca38-40be-84a2-cb3ecd7854ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.627759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b967d-ca38-40be-84a2-cb3ecd7854ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:00.631779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b967d-ca38-40be-84a2-cb3ecd7854ea admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:00.675767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1006/2032] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:00 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:00.676503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:00.689561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809efc48-a8be-4b82-875a-db71788144f2 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:00.791769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451311f-4c90-4905-bd32-63e5b292bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:00.793104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451311f-4c90-4905-bd32-63e5b292bfba admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.793428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451311f-4c90-4905-bd32-63e5b292bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.793711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451311f-4c90-4905-bd32-63e5b292bfba admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.794426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451311f-4c90-4905-bd32-63e5b292bfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:00.796477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451311f-4c90-4905-bd32-63e5b292bfba admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:00.845695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1027/2033] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:00 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:00.847362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b967d-ca38-40be-84a2-cb3ecd7854ea admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:00.869305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b967d-ca38-40be-84a2-cb3ecd7854ea admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:00.908270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2908-df60-4b1a-9146-2753e980e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:00.908956 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2908-df60-4b1a-9146-2753e980e3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.909393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2908-df60-4b1a-9146-2753e980e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.909678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b2908-df60-4b1a-9146-2753e980e3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.910536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b2908-df60-4b1a-9146-2753e980e3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:00.912306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b2908-df60-4b1a-9146-2753e980e3e8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:00.936736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451311f-4c90-4905-bd32-63e5b292bfba admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:00.943188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1007/2034] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:00.949978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451311f-4c90-4905-bd32-63e5b292bfba admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:00.956151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7edbae-331f-4ea3-ae2c-198b84f4a66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:00.957075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7edbae-331f-4ea3-ae2c-198b84f4a66c admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:00.957500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7edbae-331f-4ea3-ae2c-198b84f4a66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:00.957877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7edbae-331f-4ea3-ae2c-198b84f4a66c admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:00.958701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7edbae-331f-4ea3-ae2c-198b84f4a66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:00.960582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7edbae-331f-4ea3-ae2c-198b84f4a66c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:00.973599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1028/2035] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:00.977739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2908-df60-4b1a-9146-2753e980e3e8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:00.992907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b2908-df60-4b1a-9146-2753e980e3e8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:01.003853 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:01.005263 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:01.005711 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:01.005964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] PATH_INFO: `/v3/projects/afe9c1d72ca84e33b3431738acf61295/users/8f85454e20524acdb9d2dd01d8a71c27/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:01.027075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe9c1d72ca84e33b3431738acf61295, user_id=8f85454e20524acdb9d2dd01d8a71c27, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:01.030729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:01.062351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1008/2036] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:00 2022] PUT /identity/v3/projects/afe9c1d72ca84e33b3431738acf61295/users/8f85454e20524acdb9d2dd01d8a71c27/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:01.070365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04a51-d034-4c92-9026-b9d9aa7009ba None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:01.070669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04a51-d034-4c92-9026-b9d9aa7009ba None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:01.070948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04a51-d034-4c92-9026-b9d9aa7009ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:01.109079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4ea04a51-d034-4c92-9026-b9d9aa7009ba None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:01.110507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4ea04a51-d034-4c92-9026-b9d9aa7009ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:01.191990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1029/2037] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:01.208838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:01.211556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:01.289144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5e9fd-1daf-49b4-b7e0-c0d8561b8499 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:01.293848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:01.294517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:01.294803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:01.295119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:01.306783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:01.308342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:01.319646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1009/2038] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:02.025828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79cd5-1e2e-4ff8-99b3-c6858b4c41b8 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:02.026924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79cd5-1e2e-4ff8-99b3-c6858b4c41b8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:02.027529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79cd5-1e2e-4ff8-99b3-c6858b4c41b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:02.059140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b9d79cd5-1e2e-4ff8-99b3-c6858b4c41b8 None None] MFA Rules not processed for user `8f85454e20524acdb9d2dd01d8a71c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:02.060367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b9d79cd5-1e2e-4ff8-99b3-c6858b4c41b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:02.134282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1030/2039] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:02.145550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:02.147565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:02.211397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3226bb-8b7e-49cd-a272-4c6695276853 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:02.215320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fba7c-c33a-4fd1-8419-3d9d5d94bfac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:02.216005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fba7c-c33a-4fd1-8419-3d9d5d94bfac service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:02.216287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fba7c-c33a-4fd1-8419-3d9d5d94bfac service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:02.216563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fba7c-c33a-4fd1-8419-3d9d5d94bfac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:02.227352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fba7c-c33a-4fd1-8419-3d9d5d94bfac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:02.228818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fba7c-c33a-4fd1-8419-3d9d5d94bfac service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:02.237682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1010/2040] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:04.714004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43141-4e2c-458e-af00-074f382263cd None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:04.714499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43141-4e2c-458e-af00-074f382263cd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:04.714691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43141-4e2c-458e-af00-074f382263cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:04.733421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-bbb43141-4e2c-458e-af00-074f382263cd None None] MFA Rules not processed for user `8f85454e20524acdb9d2dd01d8a71c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:04.734681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bbb43141-4e2c-458e-af00-074f382263cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:04.741866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1031/2041] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:04.918646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fba7c-c33a-4fd1-8419-3d9d5d94bfac service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:04.928228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fba7c-c33a-4fd1-8419-3d9d5d94bfac service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:04.933110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:04.934147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:04.934721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:04.935226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:04.938488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:05.000691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:05.002142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:05.011759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1011/2042] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:05.751659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43141-4e2c-458e-af00-074f382263cd None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:05.764314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43141-4e2c-458e-af00-074f382263cd None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:05.775562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6320d-e148-4f4a-b426-98e5e1e0df47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:05.776256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6320d-e148-4f4a-b426-98e5e1e0df47 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:05.776552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6320d-e148-4f4a-b426-98e5e1e0df47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:05.776813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6320d-e148-4f4a-b426-98e5e1e0df47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:05.778828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-83c6320d-e148-4f4a-b426-98e5e1e0df47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:05.888622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6320d-e148-4f4a-b426-98e5e1e0df47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:05.891313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6320d-e148-4f4a-b426-98e5e1e0df47 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:05.904450 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1032/2043] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:06.729080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:06.730561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:06.744558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f63bbc-8b76-4bb9-99e7-e7e89b2ac818 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:06.750208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:06.751356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:06.751633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:06.751894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] PATH_INFO: `/v3/users/d61e26de3ae84980bca0da75ef882096` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:06.753093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61e26de3ae84980bca0da75ef882096)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:06.755035 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:06.806203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61e26de3ae84980bca0da75ef882096'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:06.815467 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61e26de3ae84980bca0da75ef882096'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:06.827052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61e26de3ae84980bca0da75ef882096'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:06.827756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61e26de3ae84980bca0da75ef882096'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:06.844114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61e26de3ae84980bca0da75ef882096'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:06.856556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1012/2044] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:06 2022] DELETE /identity/v3/users/d61e26de3ae84980bca0da75ef882096 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:06.861783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3d16-a471-47c9-ad9b-794f67e055e6 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:06.862272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3d16-a471-47c9-ad9b-794f67e055e6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:06.862431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a3d16-a471-47c9-ad9b-794f67e055e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:06.879809 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f44a3d16-a471-47c9-ad9b-794f67e055e6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:06.880912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f44a3d16-a471-47c9-ad9b-794f67e055e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:06.957865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1033/2045] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:06.974767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:06.976417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:07.052551 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e71246-f779-4e2e-9fe0-1db7eee66d45 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:07.057807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:07.058553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:07.058890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:07.059387 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:07.081488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:07.084557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:07.112017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a3d16-a471-47c9-ad9b-794f67e055e6 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:07.114217 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f44a3d16-a471-47c9-ad9b-794f67e055e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:07.124109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1013/2046] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:07.207779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a3d16-a471-47c9-ad9b-794f67e055e6 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:07.211937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:07.212630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:07.212915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:07.213190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:07.215834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:07.297524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:07.299272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:07.312255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1034/2047] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:07.734257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:07.736407 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:07.755286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9284e5-893d-496a-bf83-3011c069cc42 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:07.772084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:07.773188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:07.773636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:07.774096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] PATH_INFO: `/v3/projects/0023ae114cd946e4ac28f88c66b591cb` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:07.775982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0023ae114cd946e4ac28f88c66b591cb)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:07.778171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:07.841321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0023ae114cd946e4ac28f88c66b591cb', 'request_id': 'req-08d7c548-9179-4e4b-b563-868b0ef15c9a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:07.849861 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0023ae114cd946e4ac28f88c66b591cb', 'request_id': 'req-08d7c548-9179-4e4b-b563-868b0ef15c9a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:07.855923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0023ae114cd946e4ac28f88c66b591cb', 'request_id': 'req-08d7c548-9179-4e4b-b563-868b0ef15c9a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:07.867478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] The token cache is being invalidate because project 0023ae114cd946e4ac28f88c66b591cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:07.867797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:07.868472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:07.870030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1014/2048] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:07 2022] DELETE /identity/v3/projects/0023ae114cd946e4ac28f88c66b591cb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:07.874663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:07.887993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc5654-9496-4cb9-9f31-60c40563a1c4 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:07.945075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:07.945902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:07.946210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:07.946492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] PATH_INFO: `/v3/users/c38b30a25a0147a1bc3714714f07a20f` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:07.947735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38b30a25a0147a1bc3714714f07a20f)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:07.949714 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:07.997266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38b30a25a0147a1bc3714714f07a20f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.004544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38b30a25a0147a1bc3714714f07a20f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.011538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38b30a25a0147a1bc3714714f07a20f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.012201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38b30a25a0147a1bc3714714f07a20f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.023823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b2ab3231-b78e-44c2-b827-93a5767999c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38b30a25a0147a1bc3714714f07a20f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.029709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1035/2049] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:07 2022] DELETE /identity/v3/users/c38b30a25a0147a1bc3714714f07a20f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:08.402238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:08.404043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:08.418310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c548-9179-4e4b-b563-868b0ef15c9a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:08.491638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:08.492728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.493222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.493805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] PATH_INFO: `/v3/projects/b2d63c039a224628b01ba521c31f0ed5` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.496694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d63c039a224628b01ba521c31f0ed5)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:08.498642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:08.575354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d63c039a224628b01ba521c31f0ed5', 'request_id': 'req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.585613 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d63c039a224628b01ba521c31f0ed5', 'request_id': 'req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.594244 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d63c039a224628b01ba521c31f0ed5', 'request_id': 'req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.611051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] The token cache is being invalidate because project b2d63c039a224628b01ba521c31f0ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:08.611413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.612072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.613624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1015/2050] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:08 2022] DELETE /identity/v3/projects/b2d63c039a224628b01ba521c31f0ed5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:08.622019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262d1d-764f-45c7-a81a-f79875a07b3f None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.622861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262d1d-764f-45c7-a81a-f79875a07b3f None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.625443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262d1d-764f-45c7-a81a-f79875a07b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.656782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7f262d1d-764f-45c7-a81a-f79875a07b3f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:08.658178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7f262d1d-764f-45c7-a81a-f79875a07b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:08.666770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:08.668682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:08.760381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1036/2051] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:08.761820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b058-b3ee-4d8a-9035-e27bdb5076bf admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:08.768391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f04e-0194-4d82-bad7-245a8a1cbba6 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.768739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f04e-0194-4d82-bad7-245a8a1cbba6 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.768946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f04e-0194-4d82-bad7-245a8a1cbba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.769340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:08.770497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.770875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.771260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] PATH_INFO: `/v3/users/233e094e2513433fa95ed988533ea8d4` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.774450 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233e094e2513433fa95ed988533ea8d4)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:08.775427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:08.793013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-82c9f04e-0194-4d82-bad7-245a8a1cbba6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:08.794407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-82c9f04e-0194-4d82-bad7-245a8a1cbba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:08.817667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1037/2052] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:08.819299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9f04e-0194-4d82-bad7-245a8a1cbba6 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:08.845519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9f04e-0194-4d82-bad7-245a8a1cbba6 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:08.848299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233e094e2513433fa95ed988533ea8d4'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.865528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233e094e2513433fa95ed988533ea8d4'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.867323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:08.872186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.874014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.874493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.875713 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:08.879363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:08.881643 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:08.884482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233e094e2513433fa95ed988533ea8d4'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.885679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233e094e2513433fa95ed988533ea8d4'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.930346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1038/2053] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:08.930525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-7374758f-9c25-47b5-a39b-f630f60f3c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233e094e2513433fa95ed988533ea8d4'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:08.932568 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:08.936798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:08.937558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1016/2054] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:08 2022] DELETE /identity/v3/users/233e094e2513433fa95ed988533ea8d4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:08.943397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d6194-3b95-4dd6-be4f-7d05322283b7 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.943789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d6194-3b95-4dd6-be4f-7d05322283b7 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.944357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d6194-3b95-4dd6-be4f-7d05322283b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.966861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6f67-bc80-44dc-b791-1331888c0c2c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:08.978467 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-df1d6194-3b95-4dd6-be4f-7d05322283b7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:08.984021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-df1d6194-3b95-4dd6-be4f-7d05322283b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:09.056960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.059231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.059546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.060078 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.060959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.062922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.095101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1017/2055] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:09.097111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1039/2056] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:08 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:09.101503 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d6194-3b95-4dd6-be4f-7d05322283b7 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.106163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.108733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:09.112659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d6194-3b95-4dd6-be4f-7d05322283b7 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.176360 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf56c70-a58f-4f74-a3e6-9d6eec656f7d admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.180327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919364e-9a49-4ead-8827-6d2d3d684704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.180468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38c9bd-7d10-4f0a-b84c-e5c012451556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.181095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c9bd-7d10-4f0a-b84c-e5c012451556 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.181194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919364e-9a49-4ead-8827-6d2d3d684704 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.181376 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c9bd-7d10-4f0a-b84c-e5c012451556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.181472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919364e-9a49-4ead-8827-6d2d3d684704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.181650 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c9bd-7d10-4f0a-b84c-e5c012451556 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.181830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919364e-9a49-4ead-8827-6d2d3d684704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.182343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38c9bd-7d10-4f0a-b84c-e5c012451556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.184292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38c9bd-7d10-4f0a-b84c-e5c012451556 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.192366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919364e-9a49-4ead-8827-6d2d3d684704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.193794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919364e-9a49-4ead-8827-6d2d3d684704 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.205803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1018/2057] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:09 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:09.209686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38c9bd-7d10-4f0a-b84c-e5c012451556 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.215161 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1040/2058] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:09.220990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38c9bd-7d10-4f0a-b84c-e5c012451556 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.225794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3a65-6289-474a-b460-59ca4eb34977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.226867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3a65-6289-474a-b460-59ca4eb34977 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.227183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3a65-6289-474a-b460-59ca4eb34977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.227457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3a65-6289-474a-b460-59ca4eb34977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.228182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c3a65-6289-474a-b460-59ca4eb34977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.230016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c3a65-6289-474a-b460-59ca4eb34977 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.240674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1019/2059] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:09.245006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919364e-9a49-4ead-8827-6d2d3d684704 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.256047 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919364e-9a49-4ead-8827-6d2d3d684704 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.262215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df19e7-edb4-48e7-ac1b-3d6a11593641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.262881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df19e7-edb4-48e7-ac1b-3d6a11593641 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.263461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df19e7-edb4-48e7-ac1b-3d6a11593641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.263615 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df19e7-edb4-48e7-ac1b-3d6a11593641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.265233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df19e7-edb4-48e7-ac1b-3d6a11593641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.267411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df19e7-edb4-48e7-ac1b-3d6a11593641 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.281377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1041/2060] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:09.282593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3a65-6289-474a-b460-59ca4eb34977 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.292796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3a65-6289-474a-b460-59ca4eb34977 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.297600 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9de6-6f0e-4147-94d1-4c32d617e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.298510 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9de6-6f0e-4147-94d1-4c32d617e6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.298803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9de6-6f0e-4147-94d1-4c32d617e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.299117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9de6-6f0e-4147-94d1-4c32d617e6dd admin admin] PATH_INFO: `/v3/projects/0c9074b2ae7346ccad0a19ed1e7a45d5/users/95272ea726dd494f9a714f4f2d96b6fe/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.318423 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc9de6-6f0e-4147-94d1-4c32d617e6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9074b2ae7346ccad0a19ed1e7a45d5, user_id=95272ea726dd494f9a714f4f2d96b6fe, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.321328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc9de6-6f0e-4147-94d1-4c32d617e6dd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.338075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1020/2061] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:09 2022] PUT /identity/v3/projects/0c9074b2ae7346ccad0a19ed1e7a45d5/users/95272ea726dd494f9a714f4f2d96b6fe/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:09.349104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa7bce-7e66-4dfe-8231-7cee84edfb43 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.349480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa7bce-7e66-4dfe-8231-7cee84edfb43 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.349838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa7bce-7e66-4dfe-8231-7cee84edfb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.379533 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3eaa7bce-7e66-4dfe-8231-7cee84edfb43 None None] MFA Rules not processed for user `95272ea726dd494f9a714f4f2d96b6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:09.380752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3eaa7bce-7e66-4dfe-8231-7cee84edfb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:09.449772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1042/2062] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:09.455350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9de6-6f0e-4147-94d1-4c32d617e6dd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.525975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9de6-6f0e-4147-94d1-4c32d617e6dd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.532058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ada780-fb33-41a5-944a-5d78d7867e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.532881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ada780-fb33-41a5-944a-5d78d7867e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.533257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ada780-fb33-41a5-944a-5d78d7867e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.533639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ada780-fb33-41a5-944a-5d78d7867e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.534427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ada780-fb33-41a5-944a-5d78d7867e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.536779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ada780-fb33-41a5-944a-5d78d7867e0c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.564716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1021/2063] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:09 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:09.568916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa7bce-7e66-4dfe-8231-7cee84edfb43 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.594205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa7bce-7e66-4dfe-8231-7cee84edfb43 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.665735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e79d-ba04-405e-a531-0394b78bf98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.666404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e79d-ba04-405e-a531-0394b78bf98c admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.666684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e79d-ba04-405e-a531-0394b78bf98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.666976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e79d-ba04-405e-a531-0394b78bf98c admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.667668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e79d-ba04-405e-a531-0394b78bf98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.669596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e79d-ba04-405e-a531-0394b78bf98c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.693462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1043/2064] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:09 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:09.698674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ada780-fb33-41a5-944a-5d78d7867e0c admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.709152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ada780-fb33-41a5-944a-5d78d7867e0c admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.713869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.714528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.714804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.715119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.716265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.717491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.731596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1022/2065] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:09.739244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e79d-ba04-405e-a531-0394b78bf98c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.749942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e79d-ba04-405e-a531-0394b78bf98c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.755710 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38795f0e-d60b-455b-8b95-30aceb65631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.756621 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38795f0e-d60b-455b-8b95-30aceb65631a admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.756874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38795f0e-d60b-455b-8b95-30aceb65631a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.757145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38795f0e-d60b-455b-8b95-30aceb65631a admin admin] PATH_INFO: `/v3/projects/2dd472b1e5044bbaa6336d1ceb1845bd/users/73663fb303c7445a81e3c2347fcf020b/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.779196 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38795f0e-d60b-455b-8b95-30aceb65631a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd472b1e5044bbaa6336d1ceb1845bd, user_id=73663fb303c7445a81e3c2347fcf020b, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.781853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38795f0e-d60b-455b-8b95-30aceb65631a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.797507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1044/2066] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:09 2022] PUT /identity/v3/projects/2dd472b1e5044bbaa6336d1ceb1845bd/users/73663fb303c7445a81e3c2347fcf020b/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:09.799307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.799776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38795f0e-d60b-455b-8b95-30aceb65631a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.801748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:09.817345 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338c4b-6e96-4d6b-bd98-847334985510 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.866462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38795f0e-d60b-455b-8b95-30aceb65631a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.871301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12582279-28a9-4004-928f-046684f37bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.872029 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582279-28a9-4004-928f-046684f37bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.872374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582279-28a9-4004-928f-046684f37bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.872649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582279-28a9-4004-928f-046684f37bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.873377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12582279-28a9-4004-928f-046684f37bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.875716 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12582279-28a9-4004-928f-046684f37bc5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.884809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.885769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.886254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.886691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1045/2067] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:09.887012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] PATH_INFO: `/v3/projects/3acbfb0b6c7545b386a3dbf9c0bbd1be` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.888777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acbfb0b6c7545b386a3dbf9c0bbd1be)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.891427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.891718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12582279-28a9-4004-928f-046684f37bc5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.901886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12582279-28a9-4004-928f-046684f37bc5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:09.906819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1611d1-e3af-43b8-bfad-06d5e272c92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:09.907745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1611d1-e3af-43b8-bfad-06d5e272c92e admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.908021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1611d1-e3af-43b8-bfad-06d5e272c92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.908289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1611d1-e3af-43b8-bfad-06d5e272c92e admin admin] PATH_INFO: `/v3/projects/2dd472b1e5044bbaa6336d1ceb1845bd/users/73663fb303c7445a81e3c2347fcf020b/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.910231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1611d1-e3af-43b8-bfad-06d5e272c92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd472b1e5044bbaa6336d1ceb1845bd, user_id=73663fb303c7445a81e3c2347fcf020b, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:09.912887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1611d1-e3af-43b8-bfad-06d5e272c92e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:09.924394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1046/2068] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:09 2022] PUT /identity/v3/projects/2dd472b1e5044bbaa6336d1ceb1845bd/users/73663fb303c7445a81e3c2347fcf020b/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:09.935000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132e70-1f5a-4a6a-b9dc-466043b702da None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:09.935397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132e70-1f5a-4a6a-b9dc-466043b702da None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:09.935774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132e70-1f5a-4a6a-b9dc-466043b702da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:09.946472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acbfb0b6c7545b386a3dbf9c0bbd1be', 'request_id': 'req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:09.954886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acbfb0b6c7545b386a3dbf9c0bbd1be', 'request_id': 'req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:09.960624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acbfb0b6c7545b386a3dbf9c0bbd1be', 'request_id': 'req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:09.962697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-01132e70-1f5a-4a6a-b9dc-466043b702da None None] MFA Rules not processed for user `73663fb303c7445a81e3c2347fcf020b`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:09.963903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-01132e70-1f5a-4a6a-b9dc-466043b702da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:09.973022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] The token cache is being invalidate because project 3acbfb0b6c7545b386a3dbf9c0bbd1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:09.973322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:09.973994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:09.975821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1023/2069] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:09 2022] DELETE /identity/v3/projects/3acbfb0b6c7545b386a3dbf9c0bbd1be => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:09.979720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:09.981242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.047194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8a71d-17ad-4bc8-ada4-82ab7abc281e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.047427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1047/2070] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:10.051585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132e70-1f5a-4a6a-b9dc-466043b702da None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.051585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-01132e70-1f5a-4a6a-b9dc-466043b702da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.054905 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.055818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.056097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.056384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] PATH_INFO: `/v3/users/9f0214dd79cb427cb881d6372cbe5742` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.058404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0214dd79cb427cb881d6372cbe5742)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.060336 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.069912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132e70-1f5a-4a6a-b9dc-466043b702da None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.075212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.075942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.076999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.076999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] PATH_INFO: `/v3/users/d1b0a6f5fedf44f3abb03a70e0850974` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.077995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b0a6f5fedf44f3abb03a70e0850974)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.080042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.116733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0214dd79cb427cb881d6372cbe5742'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.124484 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0214dd79cb427cb881d6372cbe5742'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.132373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0214dd79cb427cb881d6372cbe5742'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.132750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b0a6f5fedf44f3abb03a70e0850974'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.133049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0214dd79cb427cb881d6372cbe5742'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.140764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b0a6f5fedf44f3abb03a70e0850974'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.145713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0214dd79cb427cb881d6372cbe5742'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.149544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b0a6f5fedf44f3abb03a70e0850974'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.150751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b0a6f5fedf44f3abb03a70e0850974'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.158659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1024/2071] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:09 2022] DELETE /identity/v3/users/9f0214dd79cb427cb881d6372cbe5742 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:10.158659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.158659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.166256 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6349de55-edb8-4120-b26b-7f2694a2b827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b0a6f5fedf44f3abb03a70e0850974'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.174168 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1048/2072] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:10 2022] DELETE /identity/v3/users/d1b0a6f5fedf44f3abb03a70e0850974 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:10.178532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48bc1a-8e0b-41cb-a28c-6fbcc5d058a4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.178876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48bc1a-8e0b-41cb-a28c-6fbcc5d058a4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.180205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48bc1a-8e0b-41cb-a28c-6fbcc5d058a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.220591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-0a48bc1a-8e0b-41cb-a28c-6fbcc5d058a4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:10.224718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0a48bc1a-8e0b-41cb-a28c-6fbcc5d058a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.258772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5038d-39d3-4b0e-acc5-d356fd7e6745 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.303975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1049/2073] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:10.314804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48bc1a-8e0b-41cb-a28c-6fbcc5d058a4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.320898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0a48bc1a-8e0b-41cb-a28c-6fbcc5d058a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.333536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.334018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.334308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.334583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.346665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.393929 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48bc1a-8e0b-41cb-a28c-6fbcc5d058a4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.399534 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.400420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.401103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.401103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.423997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.425796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.433407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.435051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.446831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1025/2074] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:10.448558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1050/2075] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:10.517810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.519428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.532310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb45b-09f1-4fab-ac14-23e109adc8c2 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.536944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4cc66-050e-4a00-96b4-ad554d7b8c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.537498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4cc66-050e-4a00-96b4-ad554d7b8c58 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.537779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4cc66-050e-4a00-96b4-ad554d7b8c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.538196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4cc66-050e-4a00-96b4-ad554d7b8c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.540232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-39e4cc66-050e-4a00-96b4-ad554d7b8c58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.558381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.560067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.578898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f862d-aade-410d-9db7-00a458794e00 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.584868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.585812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.586094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.586366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] PATH_INFO: `/v3/projects/701b1e56f6734c1396748b4bd81303be` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.588375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701b1e56f6734c1396748b4bd81303be)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.590287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.637811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4cc66-050e-4a00-96b4-ad554d7b8c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.640420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4cc66-050e-4a00-96b4-ad554d7b8c58 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.647116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701b1e56f6734c1396748b4bd81303be', 'request_id': 'req-aa5bbc32-c210-495a-975a-06d4466f1132'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.651005 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1026/2076] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:10.659015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701b1e56f6734c1396748b4bd81303be', 'request_id': 'req-aa5bbc32-c210-495a-975a-06d4466f1132'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.666713 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701b1e56f6734c1396748b4bd81303be', 'request_id': 'req-aa5bbc32-c210-495a-975a-06d4466f1132'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.681370 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] The token cache is being invalidate because project 701b1e56f6734c1396748b4bd81303be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:10.681783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.682515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-aa5bbc32-c210-495a-975a-06d4466f1132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:10.687394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1051/2077] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:10 2022] DELETE /identity/v3/projects/701b1e56f6734c1396748b4bd81303be => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:10.689395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694e43-9307-406d-b838-f53d7a1b76a8 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.689702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694e43-9307-406d-b838-f53d7a1b76a8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.690307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694e43-9307-406d-b838-f53d7a1b76a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.721249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-85694e43-9307-406d-b838-f53d7a1b76a8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:10.722481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-85694e43-9307-406d-b838-f53d7a1b76a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.804071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1027/2078] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:10.805594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8bf82-351b-4bd2-8274-900198ab883d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.805993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8bf82-351b-4bd2-8274-900198ab883d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.806386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8bf82-351b-4bd2-8274-900198ab883d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.833675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-dcf8bf82-351b-4bd2-8274-900198ab883d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:10.835430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-dcf8bf82-351b-4bd2-8274-900198ab883d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.846387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1052/2079] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:10.850821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694e43-9307-406d-b838-f53d7a1b76a8 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.864165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694e43-9307-406d-b838-f53d7a1b76a8 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.870384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.871156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.871513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.871788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.872524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:10.872821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.874952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.896672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1028/2080] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:46:10.897732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8bf82-351b-4bd2-8274-900198ab883d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.899310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-dcf8bf82-351b-4bd2-8274-900198ab883d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:10.900409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.917082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8bf82-351b-4bd2-8274-900198ab883d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.917805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f92c-fcb7-4a6a-8d44-c0776bfb99e8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:10.922995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.923698 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554647-c603-46fd-918a-54669559943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:10.924226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.924546 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554647-c603-46fd-918a-54669559943a admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:10.924844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.925009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554647-c603-46fd-918a-54669559943a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:10.925660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] PATH_INFO: `/v3/projects/d583264fee0048f386cbf3281191a9a8` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.925776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554647-c603-46fd-918a-54669559943a admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:10.926616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554647-c603-46fd-918a-54669559943a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.927481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d583264fee0048f386cbf3281191a9a8)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:10.929628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554647-c603-46fd-918a-54669559943a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.929790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:10.972862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1029/2081] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:10 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:10.977490 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554647-c603-46fd-918a-54669559943a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:10.991873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd583264fee0048f386cbf3281191a9a8', 'request_id': 'req-8726ba08-5a04-42ff-964b-4f5c03966484'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.002402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd583264fee0048f386cbf3281191a9a8', 'request_id': 'req-8726ba08-5a04-42ff-964b-4f5c03966484'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.007930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd583264fee0048f386cbf3281191a9a8', 'request_id': 'req-8726ba08-5a04-42ff-964b-4f5c03966484'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.019597 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] The token cache is being invalidate because project d583264fee0048f386cbf3281191a9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:11.019979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.020715 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.022330 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1053/2082] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:10 2022] DELETE /identity/v3/projects/d583264fee0048f386cbf3281191a9a8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:11.026059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.027344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:11.049511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554647-c603-46fd-918a-54669559943a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.096077 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726ba08-5a04-42ff-964b-4f5c03966484 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.100941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.101831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.102110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.102384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] PATH_INFO: `/v3/users/8122e3991c574336bb2f55db673a4685` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.103676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8122e3991c574336bb2f55db673a4685)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.105678 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.114599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.115300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.115579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.115851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.116534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.118470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.142332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1030/2083] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:10 2022] POST /identity/v3/users => generated 282 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:11.143351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.145021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:11.154943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8122e3991c574336bb2f55db673a4685'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.157807 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f367db3-c235-442d-8cc0-eb8d744246eb admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.161860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8122e3991c574336bb2f55db673a4685'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.162499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.163185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.163470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.163746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.164545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.166651 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.168384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8122e3991c574336bb2f55db673a4685'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.169095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8122e3991c574336bb2f55db673a4685'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.177669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1031/2084] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:11.181489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.181886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8122e3991c574336bb2f55db673a4685'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.183194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:11.188531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1054/2085] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:11 2022] DELETE /identity/v3/users/8122e3991c574336bb2f55db673a4685 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:11.196254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d7d0-d07e-42d6-9ca6-433813a1d516 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.254257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ceb5c-8b33-4f85-a2cf-66abb9232395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.254928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ceb5c-8b33-4f85-a2cf-66abb9232395 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.255243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ceb5c-8b33-4f85-a2cf-66abb9232395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.255519 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ceb5c-8b33-4f85-a2cf-66abb9232395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.256250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ceb5c-8b33-4f85-a2cf-66abb9232395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.257892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ceb5c-8b33-4f85-a2cf-66abb9232395 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.270013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1032/2086] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:11.274151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.283968 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20699a-65ba-41ec-a384-815c0f5061cb admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.288732 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e460-472f-48ae-9198-2c11127b12cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.289771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e460-472f-48ae-9198-2c11127b12cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.290058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e460-472f-48ae-9198-2c11127b12cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.290316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e460-472f-48ae-9198-2c11127b12cc admin admin] PATH_INFO: `/v3/projects/0c45a1a3ad744235a61a662ad49b94d3/users/ebfbf6599b9e4abf88400ca7d7a3cbab/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.306663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e460-472f-48ae-9198-2c11127b12cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c45a1a3ad744235a61a662ad49b94d3, user_id=ebfbf6599b9e4abf88400ca7d7a3cbab, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.309238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e460-472f-48ae-9198-2c11127b12cc admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.330720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1055/2087] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:11 2022] PUT /identity/v3/projects/0c45a1a3ad744235a61a662ad49b94d3/users/ebfbf6599b9e4abf88400ca7d7a3cbab/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:11.342046 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e4a96-1223-4efb-9cf7-638b7d2a24ca None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.342335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e4a96-1223-4efb-9cf7-638b7d2a24ca None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.342645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e4a96-1223-4efb-9cf7-638b7d2a24ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.372314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-687e4a96-1223-4efb-9cf7-638b7d2a24ca None None] MFA Rules not processed for user `ebfbf6599b9e4abf88400ca7d7a3cbab`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:11.374571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-687e4a96-1223-4efb-9cf7-638b7d2a24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:11.455623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1033/2088] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:11.459716 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e460-472f-48ae-9198-2c11127b12cc admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.525610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e4a96-1223-4efb-9cf7-638b7d2a24ca None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.527098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-687e4a96-1223-4efb-9cf7-638b7d2a24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:11.539773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e460-472f-48ae-9198-2c11127b12cc admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.545056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f5aea-3376-4a07-a6b8-f850003e6b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.546675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f5aea-3376-4a07-a6b8-f850003e6b31 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.547045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f5aea-3376-4a07-a6b8-f850003e6b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.547319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f5aea-3376-4a07-a6b8-f850003e6b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.548138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f5aea-3376-4a07-a6b8-f850003e6b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.550224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f5aea-3376-4a07-a6b8-f850003e6b31 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.578737 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1056/2089] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:11 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:11.582676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f5aea-3376-4a07-a6b8-f850003e6b31 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.598619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e4a96-1223-4efb-9cf7-638b7d2a24ca None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.641891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f5aea-3376-4a07-a6b8-f850003e6b31 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.646580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a1d5-47a6-4e31-bc44-2d8a0e1fd977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.647319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a1d5-47a6-4e31-bc44-2d8a0e1fd977 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.647601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a1d5-47a6-4e31-bc44-2d8a0e1fd977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.647935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a1d5-47a6-4e31-bc44-2d8a0e1fd977 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.648619 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69a1d5-47a6-4e31-bc44-2d8a0e1fd977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.650526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69a1d5-47a6-4e31-bc44-2d8a0e1fd977 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.652033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.652882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.653164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.653442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] PATH_INFO: `/v3/projects/2a335b5a63254cbba42507555e293464` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.654629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a335b5a63254cbba42507555e293464)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.657809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.671834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1057/2090] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:11 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:11.675947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a1d5-47a6-4e31-bc44-2d8a0e1fd977 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.685638 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a1d5-47a6-4e31-bc44-2d8a0e1fd977 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.692167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4178c-dcd4-4a2d-8b0f-43b8373d9a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.692167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4178c-dcd4-4a2d-8b0f-43b8373d9a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.692431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4178c-dcd4-4a2d-8b0f-43b8373d9a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.692708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4178c-dcd4-4a2d-8b0f-43b8373d9a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.693438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4178c-dcd4-4a2d-8b0f-43b8373d9a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.695101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4178c-dcd4-4a2d-8b0f-43b8373d9a48 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.707249 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1058/2091] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:11.711530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a335b5a63254cbba42507555e293464', 'request_id': 'req-c0202683-2b55-46ff-8c52-948c0c941e62'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.711768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4178c-dcd4-4a2d-8b0f-43b8373d9a48 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.720989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a335b5a63254cbba42507555e293464', 'request_id': 'req-c0202683-2b55-46ff-8c52-948c0c941e62'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.722067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4178c-dcd4-4a2d-8b0f-43b8373d9a48 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.727797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a335b5a63254cbba42507555e293464', 'request_id': 'req-c0202683-2b55-46ff-8c52-948c0c941e62'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.739367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] The token cache is being invalidate because project 2a335b5a63254cbba42507555e293464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:11.739505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.740219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.743037 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1034/2092] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:11 2022] DELETE /identity/v3/projects/2a335b5a63254cbba42507555e293464 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:11.745900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.747474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:11.781947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.782853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.783177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.783458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] PATH_INFO: `/v3/projects/711ae9beabc04634bd9aa4095568d347/users/acf866baf2b84d01a1df68b83a8c75c1/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.801010 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711ae9beabc04634bd9aa4095568d347, user_id=acf866baf2b84d01a1df68b83a8c75c1, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.804053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.814486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202683-2b55-46ff-8c52-948c0c941e62 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.816480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1059/2093] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:11 2022] PUT /identity/v3/projects/711ae9beabc04634bd9aa4095568d347/users/acf866baf2b84d01a1df68b83a8c75c1/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:11.820603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.822195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:11.881491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.882843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.883589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.884119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] PATH_INFO: `/v3/users/3f77a15672ce4d96a08d73452aaa45a7` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.885825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f77a15672ce4d96a08d73452aaa45a7)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.888148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.913451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4657-c268-49b4-9a16-2913f05ed272 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.921932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2dddf-5077-4321-b31e-7fe13a131dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.923044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2dddf-5077-4321-b31e-7fe13a131dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.924867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2dddf-5077-4321-b31e-7fe13a131dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.926120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2dddf-5077-4321-b31e-7fe13a131dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.927560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2dddf-5077-4321-b31e-7fe13a131dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.930889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2dddf-5077-4321-b31e-7fe13a131dd7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:11.945284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1060/2094] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:11.945869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f77a15672ce4d96a08d73452aaa45a7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.949609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2dddf-5077-4321-b31e-7fe13a131dd7 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:11.953756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f77a15672ce4d96a08d73452aaa45a7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.963604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f77a15672ce4d96a08d73452aaa45a7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.964658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f77a15672ce4d96a08d73452aaa45a7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:11.972664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2dddf-5077-4321-b31e-7fe13a131dd7 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:11.978631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:11.979962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:11.980355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:11.980760 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] PATH_INFO: `/v3/projects/711ae9beabc04634bd9aa4095568d347/users/acf866baf2b84d01a1df68b83a8c75c1/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:11.987752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711ae9beabc04634bd9aa4095568d347, user_id=acf866baf2b84d01a1df68b83a8c75c1, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:11.997834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:12.001356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-3154ccca-9b57-447e-9117-2f6773935570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f77a15672ce4d96a08d73452aaa45a7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.015408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1035/2095] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:11 2022] DELETE /identity/v3/users/3f77a15672ce4d96a08d73452aaa45a7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:12.023805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1061/2096] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:11 2022] PUT /identity/v3/projects/711ae9beabc04634bd9aa4095568d347/users/acf866baf2b84d01a1df68b83a8c75c1/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:12.038045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b6029-6a6e-47f9-b275-751757aedc23 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.038617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b6029-6a6e-47f9-b275-751757aedc23 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.039135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b6029-6a6e-47f9-b275-751757aedc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.086013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3f3b6029-6a6e-47f9-b275-751757aedc23 None None] MFA Rules not processed for user `acf866baf2b84d01a1df68b83a8c75c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:12.087678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3f3b6029-6a6e-47f9-b275-751757aedc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.191789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1036/2097] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:12.209286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:12.212772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.326821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995e10-7b8c-4fe4-86cd-bf4806f956b0 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:12.331365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5aff4-693b-4902-a654-7ef4fce7c28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:12.332413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5aff4-693b-4902-a654-7ef4fce7c28d service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.332413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5aff4-693b-4902-a654-7ef4fce7c28d service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.332607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5aff4-693b-4902-a654-7ef4fce7c28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.343182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5aff4-693b-4902-a654-7ef4fce7c28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:12.345389 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5aff4-693b-4902-a654-7ef4fce7c28d service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:12.361024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1062/2098] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:12.442582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b6029-6a6e-47f9-b275-751757aedc23 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:12.447971 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3f3b6029-6a6e-47f9-b275-751757aedc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.537689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b6029-6a6e-47f9-b275-751757aedc23 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:12.542466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5aff4-693b-4902-a654-7ef4fce7c28d service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:12.543422 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:12.544464 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.544875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.545155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] PATH_INFO: `/v3/projects/901846c755ed41bea2103455f66c1661` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.546515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=901846c755ed41bea2103455f66c1661)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:12.548672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:12.554398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5aff4-693b-4902-a654-7ef4fce7c28d service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:12.558911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5bc57-57b7-4bee-9087-a55bf6a46458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:12.559752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5bc57-57b7-4bee-9087-a55bf6a46458 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.560148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5bc57-57b7-4bee-9087-a55bf6a46458 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.560524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5bc57-57b7-4bee-9087-a55bf6a46458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.575700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-93b5bc57-57b7-4bee-9087-a55bf6a46458 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.614951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901846c755ed41bea2103455f66c1661', 'request_id': 'req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.625249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901846c755ed41bea2103455f66c1661', 'request_id': 'req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.632565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901846c755ed41bea2103455f66c1661', 'request_id': 'req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.648488 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] The token cache is being invalidate because project 901846c755ed41bea2103455f66c1661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:12.648960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.651128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.652831 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1037/2099] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:12 2022] DELETE /identity/v3/projects/901846c755ed41bea2103455f66c1661 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:12.656617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:12.661404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.672396 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5bc57-57b7-4bee-9087-a55bf6a46458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:12.674679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5bc57-57b7-4bee-9087-a55bf6a46458 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:12.693784 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1063/2100] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:12.695865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00e04-add8-4515-8631-a5d89a353d0e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.696486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00e04-add8-4515-8631-a5d89a353d0e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.698063 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00e04-add8-4515-8631-a5d89a353d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.723317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-36a00e04-add8-4515-8631-a5d89a353d0e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:12.724843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-36a00e04-add8-4515-8631-a5d89a353d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.764204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8eb72-f27e-45ff-9f6f-c1b65f1ad8ee admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:12.770721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:12.772529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.772889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.773242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] PATH_INFO: `/v3/users/70151022737d4bf5a95f42e5e24f0151` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.775444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70151022737d4bf5a95f42e5e24f0151)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:12.780655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:12.843160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1064/2101] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:12.845592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bc3c0-e567-4059-81f0-c7593ee214e0 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.845963 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bc3c0-e567-4059-81f0-c7593ee214e0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.846239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bc3c0-e567-4059-81f0-c7593ee214e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.864626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70151022737d4bf5a95f42e5e24f0151'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.874797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70151022737d4bf5a95f42e5e24f0151'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.881947 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a92bc3c0-e567-4059-81f0-c7593ee214e0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:12.883194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a92bc3c0-e567-4059-81f0-c7593ee214e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.891229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70151022737d4bf5a95f42e5e24f0151'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.892161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70151022737d4bf5a95f42e5e24f0151'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.892741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1065/2102] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:12.896912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bc3c0-e567-4059-81f0-c7593ee214e0 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:12.907042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bc3c0-e567-4059-81f0-c7593ee214e0 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:12.916240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:12.917051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.917311 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d43b6fe2-614b-453b-ad39-e067ee3803e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70151022737d4bf5a95f42e5e24f0151'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:12.917446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.917617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.918529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:12.919020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:12.921583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:12.926363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1038/2103] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:12 2022] DELETE /identity/v3/users/70151022737d4bf5a95f42e5e24f0151 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:12.932062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee3cf-b9cf-4690-aac6-3b60141880e1 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:12.932359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee3cf-b9cf-4690-aac6-3b60141880e1 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:12.932686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ee3cf-b9cf-4690-aac6-3b60141880e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:12.940869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1066/2104] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:46:12.941894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:12.944566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.956480 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6f4ee3cf-b9cf-4690-aac6-3b60141880e1 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:12.957890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6f4ee3cf-b9cf-4690-aac6-3b60141880e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:12.961978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e8587-a941-40b8-b678-cf67d9dbc506 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.033998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e08686-b9c1-4da4-9ba2-3526f2a39160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.035336 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e08686-b9c1-4da4-9ba2-3526f2a39160 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.035816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e08686-b9c1-4da4-9ba2-3526f2a39160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.036284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e08686-b9c1-4da4-9ba2-3526f2a39160 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.037255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e08686-b9c1-4da4-9ba2-3526f2a39160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.039642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e08686-b9c1-4da4-9ba2-3526f2a39160 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.053030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1039/2105] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:13.059459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ee3cf-b9cf-4690-aac6-3b60141880e1 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.061076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6f4ee3cf-b9cf-4690-aac6-3b60141880e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:13.078487 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1067/2106] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:12 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:13.084836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e08686-b9c1-4da4-9ba2-3526f2a39160 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.143821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ee3cf-b9cf-4690-aac6-3b60141880e1 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.160070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e08686-b9c1-4da4-9ba2-3526f2a39160 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.165044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398f48a-b031-47fb-b336-ea4c459de35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.165720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f48a-b031-47fb-b336-ea4c459de35a admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.165999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f48a-b031-47fb-b336-ea4c459de35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.166273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f48a-b031-47fb-b336-ea4c459de35a admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.166981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398f48a-b031-47fb-b336-ea4c459de35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.169346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398f48a-b031-47fb-b336-ea4c459de35a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.192292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1068/2107] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:13 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:13.196263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398f48a-b031-47fb-b336-ea4c459de35a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.207056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398f48a-b031-47fb-b336-ea4c459de35a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.212514 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a71c-28cf-49b4-99b9-fd0136f5dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.213312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a71c-28cf-49b4-99b9-fd0136f5dd76 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.213598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a71c-28cf-49b4-99b9-fd0136f5dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.213870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a71c-28cf-49b4-99b9-fd0136f5dd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.214590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5a71c-28cf-49b4-99b9-fd0136f5dd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.216210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5a71c-28cf-49b4-99b9-fd0136f5dd76 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.228976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1069/2108] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:13.232704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a71c-28cf-49b4-99b9-fd0136f5dd76 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.240988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eac87-df08-42b5-9834-ecc94fa22aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.241979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eac87-df08-42b5-9834-ecc94fa22aad service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.241979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eac87-df08-42b5-9834-ecc94fa22aad service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.242239 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eac87-df08-42b5-9834-ecc94fa22aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.243626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a71c-28cf-49b4-99b9-fd0136f5dd76 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.249907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467acb7-07b7-4771-a6b6-65fb3c0936ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.251009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467acb7-07b7-4771-a6b6-65fb3c0936ef admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.251009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467acb7-07b7-4771-a6b6-65fb3c0936ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.251235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467acb7-07b7-4771-a6b6-65fb3c0936ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.251920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467acb7-07b7-4771-a6b6-65fb3c0936ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.253594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467acb7-07b7-4771-a6b6-65fb3c0936ef admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.254332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24eac87-df08-42b5-9834-ecc94fa22aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.256439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24eac87-df08-42b5-9834-ecc94fa22aad service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.269508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1070/2109] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:13.270414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1040/2110] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:13.270609 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467acb7-07b7-4771-a6b6-65fb3c0936ef admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.281002 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467acb7-07b7-4771-a6b6-65fb3c0936ef admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.285942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.286818 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.287138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.287414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] PATH_INFO: `/v3/projects/690278292b0c4cc88b63050185f2882e/users/fc7f7d77508b480ca301633a096f8e32/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.304706 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=690278292b0c4cc88b63050185f2882e, user_id=fc7f7d77508b480ca301633a096f8e32, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.307853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.332302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1071/2111] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:13 2022] PUT /identity/v3/projects/690278292b0c4cc88b63050185f2882e/users/fc7f7d77508b480ca301633a096f8e32/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:13.343655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafa359-2c87-4bab-a4ab-211a2c01c32c None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.343990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafa359-2c87-4bab-a4ab-211a2c01c32c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.344298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafa359-2c87-4bab-a4ab-211a2c01c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.375224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1fafa359-2c87-4bab-a4ab-211a2c01c32c None None] MFA Rules not processed for user `fc7f7d77508b480ca301633a096f8e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:13.376513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1fafa359-2c87-4bab-a4ab-211a2c01c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:13.444103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1041/2112] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:13.455884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.457687 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:13.521501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e9937-5f23-459e-abf9-bd5a82c182ae admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.528476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78091373-3313-41ad-8d1b-dbb35e06b958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.529121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091373-3313-41ad-8d1b-dbb35e06b958 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.529402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091373-3313-41ad-8d1b-dbb35e06b958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.529692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091373-3313-41ad-8d1b-dbb35e06b958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.538755 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78091373-3313-41ad-8d1b-dbb35e06b958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.540213 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78091373-3313-41ad-8d1b-dbb35e06b958 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.549348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1072/2113] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:13.610431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafa359-2c87-4bab-a4ab-211a2c01c32c None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.612404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1fafa359-2c87-4bab-a4ab-211a2c01c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:13.683227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafa359-2c87-4bab-a4ab-211a2c01c32c None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.688589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.689443 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.689723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.689991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] PATH_INFO: `/v3/projects/802e3083643a437881a018696e4d937e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.691242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=802e3083643a437881a018696e4d937e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.693099 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.749902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802e3083643a437881a018696e4d937e', 'request_id': 'req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:13.757541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802e3083643a437881a018696e4d937e', 'request_id': 'req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:13.771227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802e3083643a437881a018696e4d937e', 'request_id': 'req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:13.786465 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] The token cache is being invalidate because project 802e3083643a437881a018696e4d937e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:13.786761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:13.787736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:13.789619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1042/2114] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:13 2022] DELETE /identity/v3/projects/802e3083643a437881a018696e4d937e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:13.793832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78091373-3313-41ad-8d1b-dbb35e06b958 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.828295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.829830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:13.831358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78091373-3313-41ad-8d1b-dbb35e06b958 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.924488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.926736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.927215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.927498 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] PATH_INFO: `/v3/users/33655d10fd104b3b9466c6a87387419c` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.928908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33655d10fd104b3b9466c6a87387419c)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.932049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.947115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e09ff-81c4-4f0b-84fc-ae8b04bb1e55 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.961638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.962716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.963140 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.963627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] PATH_INFO: `/v3/users/95272ea726dd494f9a714f4f2d96b6fe` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.965808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] RBAC: Authorizing `identity:delete_user(user_id=95272ea726dd494f9a714f4f2d96b6fe)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.968277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:14.006348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33655d10fd104b3b9466c6a87387419c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.016121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33655d10fd104b3b9466c6a87387419c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.024284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33655d10fd104b3b9466c6a87387419c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.025064 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33655d10fd104b3b9466c6a87387419c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.025655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95272ea726dd494f9a714f4f2d96b6fe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.032646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95272ea726dd494f9a714f4f2d96b6fe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.037553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-eda16df4-008e-4aec-972c-e592f77ab793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33655d10fd104b3b9466c6a87387419c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.042109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95272ea726dd494f9a714f4f2d96b6fe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.042732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95272ea726dd494f9a714f4f2d96b6fe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.044700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1073/2115] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:13 2022] DELETE /identity/v3/users/33655d10fd104b3b9466c6a87387419c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:14.060165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95272ea726dd494f9a714f4f2d96b6fe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.066747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1043/2116] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:13 2022] DELETE /identity/v3/users/95272ea726dd494f9a714f4f2d96b6fe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:14.071319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc025e-fa57-4d58-9dbd-47af4a855afc None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.071667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc025e-fa57-4d58-9dbd-47af4a855afc None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.071958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc025e-fa57-4d58-9dbd-47af4a855afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.096689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3cbc025e-fa57-4d58-9dbd-47af4a855afc None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:14.098395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3cbc025e-fa57-4d58-9dbd-47af4a855afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:14.173044 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1074/2117] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:14.183907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:14.185419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:14.252071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764876d-ba9c-43f1-8202-4d05ffe5ecea admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:14.255751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb5f09-cd04-4113-aa9e-86f0e2abf675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:14.256402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb5f09-cd04-4113-aa9e-86f0e2abf675 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.256684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb5f09-cd04-4113-aa9e-86f0e2abf675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.256963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb5f09-cd04-4113-aa9e-86f0e2abf675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.268699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb5f09-cd04-4113-aa9e-86f0e2abf675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:14.270339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb5f09-cd04-4113-aa9e-86f0e2abf675 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:14.282808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1044/2118] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:14.410230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc025e-fa57-4d58-9dbd-47af4a855afc None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:14.412434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3cbc025e-fa57-4d58-9dbd-47af4a855afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:14.440362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc025e-fa57-4d58-9dbd-47af4a855afc None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:14.466456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:14.468014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.468302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.468624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] PATH_INFO: `/v3/projects/10eb1b0b373d4fceb7b7209b87314ee2` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.470264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10eb1b0b373d4fceb7b7209b87314ee2)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:14.473871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:14.560359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10eb1b0b373d4fceb7b7209b87314ee2', 'request_id': 'req-6bb13084-33f2-48dc-9933-1461bb96388a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.569501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10eb1b0b373d4fceb7b7209b87314ee2', 'request_id': 'req-6bb13084-33f2-48dc-9933-1461bb96388a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.577761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10eb1b0b373d4fceb7b7209b87314ee2', 'request_id': 'req-6bb13084-33f2-48dc-9933-1461bb96388a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.592066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] The token cache is being invalidate because project 10eb1b0b373d4fceb7b7209b87314ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:14.592653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.593486 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb13084-33f2-48dc-9933-1461bb96388a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.596172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1075/2119] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:14 2022] DELETE /identity/v3/projects/10eb1b0b373d4fceb7b7209b87314ee2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:14.602110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba05d-f795-4720-80ab-70d1d40fc582 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.602406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba05d-f795-4720-80ab-70d1d40fc582 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.602712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba05d-f795-4720-80ab-70d1d40fc582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.621608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-383ba05d-f795-4720-80ab-70d1d40fc582 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:14.622899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-383ba05d-f795-4720-80ab-70d1d40fc582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:14.681918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1045/2120] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:14.691961 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6ff2-9fe8-4229-bb01-92f6710a6fa0 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.692252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6ff2-9fe8-4229-bb01-92f6710a6fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.692530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6ff2-9fe8-4229-bb01-92f6710a6fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.711723 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-233e6ff2-9fe8-4229-bb01-92f6710a6fa0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:14.712922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-233e6ff2-9fe8-4229-bb01-92f6710a6fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:14.721011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1076/2121] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:14.725218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba05d-f795-4720-80ab-70d1d40fc582 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:14.734555 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba05d-f795-4720-80ab-70d1d40fc582 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:14.739205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:14.739786 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.740068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.740689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.741064 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:14.741368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:14.742984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:14.755559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1046/2122] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:14.760541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e6ff2-9fe8-4229-bb01-92f6710a6fa0 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:14.780933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e6ff2-9fe8-4229-bb01-92f6710a6fa0 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:14.785813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a4e5-6891-4ada-9ad8-1f78788fac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:14.786481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a4e5-6891-4ada-9ad8-1f78788fac78 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.786767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a4e5-6891-4ada-9ad8-1f78788fac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.787091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743a4e5-6891-4ada-9ad8-1f78788fac78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.788054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743a4e5-6891-4ada-9ad8-1f78788fac78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:14.789759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743a4e5-6891-4ada-9ad8-1f78788fac78 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:14.823993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:14.825333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1077/2123] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:14 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:14.829229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:14.829761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a4e5-6891-4ada-9ad8-1f78788fac78 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:14.843790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf2ec9-e4c6-4e73-a14b-f332a33888a5 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:14.903636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743a4e5-6891-4ada-9ad8-1f78788fac78 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:14.908858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb3a9-b163-44ab-b2d4-7458f81b0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:14.909529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb3a9-b163-44ab-b2d4-7458f81b0c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.909812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb3a9-b163-44ab-b2d4-7458f81b0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.910083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb3a9-b163-44ab-b2d4-7458f81b0c8e admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.910769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb3a9-b163-44ab-b2d4-7458f81b0c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:14.911924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:14.912777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:14.912940 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb3a9-b163-44ab-b2d4-7458f81b0c8e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:14.913055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:14.913329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] PATH_INFO: `/v3/projects/0c9074b2ae7346ccad0a19ed1e7a45d5` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:14.914491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9074b2ae7346ccad0a19ed1e7a45d5)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:14.916408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:14.937378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1078/2124] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:14 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:14.941306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb3a9-b163-44ab-b2d4-7458f81b0c8e admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:14.959160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb3a9-b163-44ab-b2d4-7458f81b0c8e admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:14.967485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9074b2ae7346ccad0a19ed1e7a45d5', 'request_id': 'req-56cd49bd-b7ca-409b-99b5-47439917e2e0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.977307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9074b2ae7346ccad0a19ed1e7a45d5', 'request_id': 'req-56cd49bd-b7ca-409b-99b5-47439917e2e0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.985023 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9074b2ae7346ccad0a19ed1e7a45d5', 'request_id': 'req-56cd49bd-b7ca-409b-99b5-47439917e2e0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.996908 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] The token cache is being invalidate because project 0c9074b2ae7346ccad0a19ed1e7a45d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:14.997377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:14.998176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.000433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1047/2125] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:14 2022] DELETE /identity/v3/projects/0c9074b2ae7346ccad0a19ed1e7a45d5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:15.004229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:15.005722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:15.019768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:15.020544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.020991 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.021339 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.022178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:15.024348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:15.036868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1079/2126] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:15.041099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:15.043191 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:15.059671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c088d-3c2a-4775-a0d7-17618345c4fd admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:15.065917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d69abe-0bb7-4a42-b710-4c74774f2214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:15.066802 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d69abe-0bb7-4a42-b710-4c74774f2214 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.067357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d69abe-0bb7-4a42-b710-4c74774f2214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.067861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d69abe-0bb7-4a42-b710-4c74774f2214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.069037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d69abe-0bb7-4a42-b710-4c74774f2214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:15.071058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d69abe-0bb7-4a42-b710-4c74774f2214 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:15.081183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd49bd-b7ca-409b-99b5-47439917e2e0 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:15.085417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1080/2127] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:15.090048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d69abe-0bb7-4a42-b710-4c74774f2214 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:15.092121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:15.093070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.093351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.093628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] PATH_INFO: `/v3/users/73663fb303c7445a81e3c2347fcf020b` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.096074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73663fb303c7445a81e3c2347fcf020b)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:15.098116 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:15.100819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d69abe-0bb7-4a42-b710-4c74774f2214 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:15.106483 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd24760-3c05-4d86-968c-c7a6ebad5796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:15.107772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24760-3c05-4d86-968c-c7a6ebad5796 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.108782 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24760-3c05-4d86-968c-c7a6ebad5796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.109231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24760-3c05-4d86-968c-c7a6ebad5796 admin admin] PATH_INFO: `/v3/projects/a97885bd324a420993a9779fb2b9caa9/users/a0da24b472464de7a31f8dc127309700/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.129704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd24760-3c05-4d86-968c-c7a6ebad5796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97885bd324a420993a9779fb2b9caa9, user_id=a0da24b472464de7a31f8dc127309700, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:15.132623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd24760-3c05-4d86-968c-c7a6ebad5796 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:15.164844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1081/2128] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:15 2022] PUT /identity/v3/projects/a97885bd324a420993a9779fb2b9caa9/users/a0da24b472464de7a31f8dc127309700/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:15.169195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba496f20-e2a6-447a-a821-35f3dc0d884d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.169513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba496f20-e2a6-447a-a821-35f3dc0d884d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.169833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba496f20-e2a6-447a-a821-35f3dc0d884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.199479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73663fb303c7445a81e3c2347fcf020b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.209508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73663fb303c7445a81e3c2347fcf020b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.214351 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ba496f20-e2a6-447a-a821-35f3dc0d884d None None] MFA Rules not processed for user `a0da24b472464de7a31f8dc127309700`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:15.216202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ba496f20-e2a6-447a-a821-35f3dc0d884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:15.221548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73663fb303c7445a81e3c2347fcf020b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.222289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73663fb303c7445a81e3c2347fcf020b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.236102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73663fb303c7445a81e3c2347fcf020b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.246809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1048/2129] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:15 2022] DELETE /identity/v3/users/73663fb303c7445a81e3c2347fcf020b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:15.284261 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1082/2130] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:15.297216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:15.298795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:15.358404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ec1eb-7a7b-49df-b937-67689275fbd8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:15.362881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c841f-ad9a-4376-99cd-68dd485feda0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039df81163264994a86fe2e98bb96983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:15.363553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c841f-ad9a-4376-99cd-68dd485feda0 service glance] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.363832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c841f-ad9a-4376-99cd-68dd485feda0 service glance] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.364102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c841f-ad9a-4376-99cd-68dd485feda0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.423869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c841f-ad9a-4376-99cd-68dd485feda0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:15.425575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c841f-ad9a-4376-99cd-68dd485feda0 service glance] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:15.436717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1049/2131] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:15.535742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba496f20-e2a6-447a-a821-35f3dc0d884d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:15.537357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ba496f20-e2a6-447a-a821-35f3dc0d884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:15.628377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba496f20-e2a6-447a-a821-35f3dc0d884d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:15.691471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:15.692335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.692613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.692884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] PATH_INFO: `/v3/projects/2dd472b1e5044bbaa6336d1ceb1845bd` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.694058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd472b1e5044bbaa6336d1ceb1845bd)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:15.695985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:15.748380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd472b1e5044bbaa6336d1ceb1845bd', 'request_id': 'req-960f0a1a-8885-437a-83a7-c68f2fa54519'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.757654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd472b1e5044bbaa6336d1ceb1845bd', 'request_id': 'req-960f0a1a-8885-437a-83a7-c68f2fa54519'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.763635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd472b1e5044bbaa6336d1ceb1845bd', 'request_id': 'req-960f0a1a-8885-437a-83a7-c68f2fa54519'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.776107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] The token cache is being invalidate because project 2dd472b1e5044bbaa6336d1ceb1845bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:15.776388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.777043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-960f0a1a-8885-437a-83a7-c68f2fa54519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:15.778706 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1083/2132] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:15 2022] DELETE /identity/v3/projects/2dd472b1e5044bbaa6336d1ceb1845bd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:15.787533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0dec1-0e27-4477-9925-fb6be17fab83 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.787842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0dec1-0e27-4477-9925-fb6be17fab83 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.788091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0dec1-0e27-4477-9925-fb6be17fab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.809971 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-51e0dec1-0e27-4477-9925-fb6be17fab83 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:15.811949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-51e0dec1-0e27-4477-9925-fb6be17fab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:15.899942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1050/2133] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:15.908327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b35d1-ba3b-40e3-a558-adb2f3fe3ce9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.908621 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b35d1-ba3b-40e3-a558-adb2f3fe3ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.908960 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b35d1-ba3b-40e3-a558-adb2f3fe3ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.942316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4d0b35d1-ba3b-40e3-a558-adb2f3fe3ce9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:15.945733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4d0b35d1-ba3b-40e3-a558-adb2f3fe3ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:15.963621 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1084/2134] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:15.969054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0dec1-0e27-4477-9925-fb6be17fab83 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:15.980142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0dec1-0e27-4477-9925-fb6be17fab83 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:15.987848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:15.989385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.989836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.990113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.990857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:15.991268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.005094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.025095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1051/2135] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:16.029717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b35d1-ba3b-40e3-a558-adb2f3fe3ce9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.040993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b35d1-ba3b-40e3-a558-adb2f3fe3ce9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.047564 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59342117-56fe-4c97-9b69-698db171cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.048552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342117-56fe-4c97-9b69-698db171cab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.048985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342117-56fe-4c97-9b69-698db171cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.049416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59342117-56fe-4c97-9b69-698db171cab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.050242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59342117-56fe-4c97-9b69-698db171cab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.052779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59342117-56fe-4c97-9b69-698db171cab8 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.087689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1085/2136] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:16 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:16.092295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.115864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678628-4aa4-47eb-b28e-903c9a6e8639 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.173920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbf094-fc4a-40c3-a36a-44170fd968dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.174588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf094-fc4a-40c3-a36a-44170fd968dc admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.174869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf094-fc4a-40c3-a36a-44170fd968dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.175640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf094-fc4a-40c3-a36a-44170fd968dc admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.176324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbf094-fc4a-40c3-a36a-44170fd968dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.178229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbf094-fc4a-40c3-a36a-44170fd968dc admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.198925 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1052/2137] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:16 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:16.204168 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59342117-56fe-4c97-9b69-698db171cab8 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.215537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59342117-56fe-4c97-9b69-698db171cab8 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.220420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8676b93-f19d-453d-9701-dea4c5084524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.221089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8676b93-f19d-453d-9701-dea4c5084524 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.221369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8676b93-f19d-453d-9701-dea4c5084524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.221643 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8676b93-f19d-453d-9701-dea4c5084524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.222369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8676b93-f19d-453d-9701-dea4c5084524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.223977 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8676b93-f19d-453d-9701-dea4c5084524 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.234326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1086/2138] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:16.238651 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbf094-fc4a-40c3-a36a-44170fd968dc admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.249723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbf094-fc4a-40c3-a36a-44170fd968dc admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.254435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0c083-02dd-491a-bba7-ef20d115ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.255135 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c083-02dd-491a-bba7-ef20d115ffad admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.255418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c083-02dd-491a-bba7-ef20d115ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.255696 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c083-02dd-491a-bba7-ef20d115ffad admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.256514 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0c083-02dd-491a-bba7-ef20d115ffad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.263440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0c083-02dd-491a-bba7-ef20d115ffad admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.279007 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1053/2139] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:16.280462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8676b93-f19d-453d-9701-dea4c5084524 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.291711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8676b93-f19d-453d-9701-dea4c5084524 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.297080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2c8e4-c8c5-4e1d-80f4-b23052859a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.298017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2c8e4-c8c5-4e1d-80f4-b23052859a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.298898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2c8e4-c8c5-4e1d-80f4-b23052859a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.299254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2c8e4-c8c5-4e1d-80f4-b23052859a08 admin admin] PATH_INFO: `/v3/projects/fc7b66ea17e149ddb09efb21f22e5be0/users/6ce8bde4db3749c7968c0899e2e1d01f/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.316138 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2c8e4-c8c5-4e1d-80f4-b23052859a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7b66ea17e149ddb09efb21f22e5be0, user_id=6ce8bde4db3749c7968c0899e2e1d01f, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.319464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2c8e4-c8c5-4e1d-80f4-b23052859a08 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.333742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1087/2140] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:16 2022] PUT /identity/v3/projects/fc7b66ea17e149ddb09efb21f22e5be0/users/6ce8bde4db3749c7968c0899e2e1d01f/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:16.345557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436d171-0a91-4601-9b90-2b6e04a60672 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.345870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436d171-0a91-4601-9b90-2b6e04a60672 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.346094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436d171-0a91-4601-9b90-2b6e04a60672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.377778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5436d171-0a91-4601-9b90-2b6e04a60672 None None] MFA Rules not processed for user `6ce8bde4db3749c7968c0899e2e1d01f`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:16.379188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5436d171-0a91-4601-9b90-2b6e04a60672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:16.455721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1054/2141] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:16.460112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2c8e4-c8c5-4e1d-80f4-b23052859a08 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.526328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2c8e4-c8c5-4e1d-80f4-b23052859a08 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.530924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8965-91b8-46c2-adfb-dd97ea75e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.531595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8965-91b8-46c2-adfb-dd97ea75e8ad admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.531873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8965-91b8-46c2-adfb-dd97ea75e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.532146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8965-91b8-46c2-adfb-dd97ea75e8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.532823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a8965-91b8-46c2-adfb-dd97ea75e8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.534712 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a8965-91b8-46c2-adfb-dd97ea75e8ad admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.563910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1088/2142] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:16 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:16.565015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436d171-0a91-4601-9b90-2b6e04a60672 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.575610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436d171-0a91-4601-9b90-2b6e04a60672 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.633413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae7208-b058-43f6-8ade-1404daa0913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.634072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7208-b058-43f6-8ade-1404daa0913c admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.634362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7208-b058-43f6-8ade-1404daa0913c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.634631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7208-b058-43f6-8ade-1404daa0913c admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.635341 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae7208-b058-43f6-8ade-1404daa0913c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.637260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae7208-b058-43f6-8ade-1404daa0913c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.656131 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1055/2143] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:16 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:16.660290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8965-91b8-46c2-adfb-dd97ea75e8ad admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.670194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8965-91b8-46c2-adfb-dd97ea75e8ad admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.675651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb336-2939-4325-9940-34a2accc79a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.676342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb336-2939-4325-9940-34a2accc79a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.676627 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb336-2939-4325-9940-34a2accc79a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.676905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb336-2939-4325-9940-34a2accc79a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.677631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb336-2939-4325-9940-34a2accc79a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.679348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb336-2939-4325-9940-34a2accc79a4 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.691108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1089/2144] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:16.695113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae7208-b058-43f6-8ade-1404daa0913c admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.704988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae7208-b058-43f6-8ade-1404daa0913c admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.709602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef38a8-2173-4257-be2b-6231be9b6ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.710463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef38a8-2173-4257-be2b-6231be9b6ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.710742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef38a8-2173-4257-be2b-6231be9b6ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.711057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef38a8-2173-4257-be2b-6231be9b6ab8 admin admin] PATH_INFO: `/v3/projects/e25f9e85b7d0453984f31be253a0f4c0/users/ad3bb7f7f0dc45ffa9ab507ecb2ef733/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.725671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef38a8-2173-4257-be2b-6231be9b6ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25f9e85b7d0453984f31be253a0f4c0, user_id=ad3bb7f7f0dc45ffa9ab507ecb2ef733, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.728331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef38a8-2173-4257-be2b-6231be9b6ab8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.741419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1056/2145] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:16 2022] PUT /identity/v3/projects/e25f9e85b7d0453984f31be253a0f4c0/users/ad3bb7f7f0dc45ffa9ab507ecb2ef733/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:16.745395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb336-2939-4325-9940-34a2accc79a4 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.755331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb336-2939-4325-9940-34a2accc79a4 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.811049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224fa1a-9a2f-4b63-9f14-ea374aba002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.811765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224fa1a-9a2f-4b63-9f14-ea374aba002f admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.812088 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224fa1a-9a2f-4b63-9f14-ea374aba002f admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.812437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224fa1a-9a2f-4b63-9f14-ea374aba002f admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.813218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224fa1a-9a2f-4b63-9f14-ea374aba002f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.814781 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224fa1a-9a2f-4b63-9f14-ea374aba002f admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.824188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1090/2146] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:16.828453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef38a8-2173-4257-be2b-6231be9b6ab8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.838618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef38a8-2173-4257-be2b-6231be9b6ab8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:16.843712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:16.844569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.844842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.845130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] PATH_INFO: `/v3/projects/e25f9e85b7d0453984f31be253a0f4c0/users/ad3bb7f7f0dc45ffa9ab507ecb2ef733/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.847126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25f9e85b7d0453984f31be253a0f4c0, user_id=ad3bb7f7f0dc45ffa9ab507ecb2ef733, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:16.849772 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.860203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1057/2147] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:16 2022] PUT /identity/v3/projects/e25f9e85b7d0453984f31be253a0f4c0/users/ad3bb7f7f0dc45ffa9ab507ecb2ef733/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:16.869923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdae0b0-8e07-4b3e-876b-9460b5d6ebe2 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:16.870207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdae0b0-8e07-4b3e-876b-9460b5d6ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:16.870479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdae0b0-8e07-4b3e-876b-9460b5d6ebe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:16.896896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-bfdae0b0-8e07-4b3e-876b-9460b5d6ebe2 None None] MFA Rules not processed for user `ad3bb7f7f0dc45ffa9ab507ecb2ef733`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:16.898111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bfdae0b0-8e07-4b3e-876b-9460b5d6ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:16.963764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1091/2148] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:16.975243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:16.977070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:17.033327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff934bb-8b01-4278-bb4b-5e320d461b40 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:17.036963 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a459e18-d79e-4b34-93c0-563812b9b941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:17.037626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459e18-d79e-4b34-93c0-563812b9b941 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:17.037909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459e18-d79e-4b34-93c0-563812b9b941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:17.038187 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459e18-d79e-4b34-93c0-563812b9b941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:17.047619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459e18-d79e-4b34-93c0-563812b9b941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:17.049029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459e18-d79e-4b34-93c0-563812b9b941 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:17.058500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1058/2149] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:17.085117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdae0b0-8e07-4b3e-876b-9460b5d6ebe2 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:17.147713 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdae0b0-8e07-4b3e-876b-9460b5d6ebe2 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:17.152506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:17.153388 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:17.153663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:17.153930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] PATH_INFO: `/v3/users/6ce8bde4db3749c7968c0899e2e1d01f` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:17.155807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce8bde4db3749c7968c0899e2e1d01f)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:17.158397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:17.205835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce8bde4db3749c7968c0899e2e1d01f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.213293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce8bde4db3749c7968c0899e2e1d01f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.224473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce8bde4db3749c7968c0899e2e1d01f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.225124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce8bde4db3749c7968c0899e2e1d01f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.240148 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce8bde4db3749c7968c0899e2e1d01f'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.247333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1092/2150] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:17 2022] DELETE /identity/v3/users/6ce8bde4db3749c7968c0899e2e1d01f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:17.251726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8faa9-758d-4d1f-87ef-0741a038206a None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:17.252018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8faa9-758d-4d1f-87ef-0741a038206a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:17.252297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8faa9-758d-4d1f-87ef-0741a038206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:17.271147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d2b8faa9-758d-4d1f-87ef-0741a038206a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:17.272351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d2b8faa9-758d-4d1f-87ef-0741a038206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:17.338398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1059/2151] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:17.352313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:17.353807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:17.409299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd40318-e851-4da8-beac-9f01af2e472a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:17.412896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7235-c69b-43e7-a188-1af9a3a8c3d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:17.413530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7235-c69b-43e7-a188-1af9a3a8c3d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:17.413811 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7235-c69b-43e7-a188-1af9a3a8c3d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:17.414083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f7235-c69b-43e7-a188-1af9a3a8c3d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:17.422689 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f7235-c69b-43e7-a188-1af9a3a8c3d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:17.424136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f7235-c69b-43e7-a188-1af9a3a8c3d6 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:17.433474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1093/2152] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:17.760104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8faa9-758d-4d1f-87ef-0741a038206a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:17.761610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d2b8faa9-758d-4d1f-87ef-0741a038206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:17.774003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8faa9-758d-4d1f-87ef-0741a038206a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:17.778507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:17.779399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:17.779681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:17.779979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] PATH_INFO: `/v3/projects/fc7b66ea17e149ddb09efb21f22e5be0` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:17.781146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7b66ea17e149ddb09efb21f22e5be0)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:17.783090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:17.828184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7b66ea17e149ddb09efb21f22e5be0', 'request_id': 'req-fae26afc-6c67-463e-aaf4-9a5738e569d1'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.835012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7b66ea17e149ddb09efb21f22e5be0', 'request_id': 'req-fae26afc-6c67-463e-aaf4-9a5738e569d1'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.840374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7b66ea17e149ddb09efb21f22e5be0', 'request_id': 'req-fae26afc-6c67-463e-aaf4-9a5738e569d1'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.850863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] The token cache is being invalidate because project fc7b66ea17e149ddb09efb21f22e5be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:17.851179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.851811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.853362 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1060/2153] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:17 2022] DELETE /identity/v3/projects/fc7b66ea17e149ddb09efb21f22e5be0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:17.857248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7235-c69b-43e7-a188-1af9a3a8c3d6 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:17.867367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f7235-c69b-43e7-a188-1af9a3a8c3d6 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:17.922537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:17.923482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:17.923758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:17.924025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] PATH_INFO: `/v3/users/ad3bb7f7f0dc45ffa9ab507ecb2ef733` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:17.925226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3bb7f7f0dc45ffa9ab507ecb2ef733)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:17.927448 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:17.971435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3bb7f7f0dc45ffa9ab507ecb2ef733'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.978047 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3bb7f7f0dc45ffa9ab507ecb2ef733'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.985368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3bb7f7f0dc45ffa9ab507ecb2ef733'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.985974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3bb7f7f0dc45ffa9ab507ecb2ef733'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:17.997458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d8cdfcd6-49ba-4748-b855-13b93d226860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3bb7f7f0dc45ffa9ab507ecb2ef733'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:18.003895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1094/2154] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:17 2022] DELETE /identity/v3/users/ad3bb7f7f0dc45ffa9ab507ecb2ef733 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:18.290092 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:18.291604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:18.310404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae26afc-6c67-463e-aaf4-9a5738e569d1 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:18.390506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:18.391508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:18.391735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:18.392026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] PATH_INFO: `/v3/projects/e25f9e85b7d0453984f31be253a0f4c0` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:18.393282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25f9e85b7d0453984f31be253a0f4c0)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:18.395229 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:18.466157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25f9e85b7d0453984f31be253a0f4c0', 'request_id': 'req-be161cbe-2bb3-4325-aaa1-8f029735cf1c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:18.477701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25f9e85b7d0453984f31be253a0f4c0', 'request_id': 'req-be161cbe-2bb3-4325-aaa1-8f029735cf1c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:18.485572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25f9e85b7d0453984f31be253a0f4c0', 'request_id': 'req-be161cbe-2bb3-4325-aaa1-8f029735cf1c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:18.497884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] The token cache is being invalidate because project e25f9e85b7d0453984f31be253a0f4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:18.498174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:18.498871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-be161cbe-2bb3-4325-aaa1-8f029735cf1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:18.500666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1061/2155] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:18 2022] DELETE /identity/v3/projects/e25f9e85b7d0453984f31be253a0f4c0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:18.506303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a257f6-3cd7-4d61-82e0-39adae518b5d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:18.506658 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a257f6-3cd7-4d61-82e0-39adae518b5d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:18.507033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a257f6-3cd7-4d61-82e0-39adae518b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:18.527195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-05a257f6-3cd7-4d61-82e0-39adae518b5d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:18.528519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-05a257f6-3cd7-4d61-82e0-39adae518b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:18.601027 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1095/2156] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:18.613426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb65d2b-5ad2-4e20-ad9d-fcb90ffca4a4 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:18.613721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb65d2b-5ad2-4e20-ad9d-fcb90ffca4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:18.614715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb65d2b-5ad2-4e20-ad9d-fcb90ffca4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:18.635743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5cb65d2b-5ad2-4e20-ad9d-fcb90ffca4a4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:18.637122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5cb65d2b-5ad2-4e20-ad9d-fcb90ffca4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:18.647760 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1062/2157] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:18.654244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a257f6-3cd7-4d61-82e0-39adae518b5d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:18.667394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a257f6-3cd7-4d61-82e0-39adae518b5d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:18.705418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:18.705418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:18.705418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:18.705418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:18.705930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:18.705930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:18.705930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:18.728305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1096/2158] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:46:18.729128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb65d2b-5ad2-4e20-ad9d-fcb90ffca4a4 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:18.748041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb65d2b-5ad2-4e20-ad9d-fcb90ffca4a4 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:18.753550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc59f2-a998-4aaf-bfb9-e492892e9533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:18.754006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc59f2-a998-4aaf-bfb9-e492892e9533 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:18.754291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc59f2-a998-4aaf-bfb9-e492892e9533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:18.754566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc59f2-a998-4aaf-bfb9-e492892e9533 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:18.755369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc59f2-a998-4aaf-bfb9-e492892e9533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:18.757533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc59f2-a998-4aaf-bfb9-e492892e9533 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:18.791598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1063/2159] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:18 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:18.797054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:18.809672 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a7f5-5b4e-43e1-bbee-acf3004ddd3a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:18.900625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e52da-13d2-429b-9f8d-424c6b0522bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:18.901306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e52da-13d2-429b-9f8d-424c6b0522bc admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:18.901588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e52da-13d2-429b-9f8d-424c6b0522bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:18.901861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e52da-13d2-429b-9f8d-424c6b0522bc admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:18.902557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e52da-13d2-429b-9f8d-424c6b0522bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:18.904539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e52da-13d2-429b-9f8d-424c6b0522bc admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:18.926572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1097/2160] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:18 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:18.930777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc59f2-a998-4aaf-bfb9-e492892e9533 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:18.948964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc59f2-a998-4aaf-bfb9-e492892e9533 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:18.954226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f8d8-a432-4d89-81e7-15ae08b3424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:18.954934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f8d8-a432-4d89-81e7-15ae08b3424f admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:18.955273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f8d8-a432-4d89-81e7-15ae08b3424f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:18.955541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f8d8-a432-4d89-81e7-15ae08b3424f admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:18.956265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019f8d8-a432-4d89-81e7-15ae08b3424f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:18.957858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019f8d8-a432-4d89-81e7-15ae08b3424f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:18.971029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1064/2161] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:18.973128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e52da-13d2-429b-9f8d-424c6b0522bc admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:18.984958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e52da-13d2-429b-9f8d-424c6b0522bc admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:18.989745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6b6e8-23a2-473b-b048-151269e28cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:18.990413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b6e8-23a2-473b-b048-151269e28cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:18.990702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b6e8-23a2-473b-b048-151269e28cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:18.991006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b6e8-23a2-473b-b048-151269e28cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:18.991739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6b6e8-23a2-473b-b048-151269e28cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:18.993331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6b6e8-23a2-473b-b048-151269e28cd1 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.006309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1098/2162] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:19.010545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f8d8-a432-4d89-81e7-15ae08b3424f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.021224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f8d8-a432-4d89-81e7-15ae08b3424f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.025775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7dc69-fa3e-4c82-930b-b56d4171d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.026644 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7dc69-fa3e-4c82-930b-b56d4171d7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.026920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7dc69-fa3e-4c82-930b-b56d4171d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.027220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7dc69-fa3e-4c82-930b-b56d4171d7a2 admin admin] PATH_INFO: `/v3/projects/2a2c98860f6c43df9884277600bd9295/users/f7df097897be44eb93dac9fb15a36547/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.048196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7dc69-fa3e-4c82-930b-b56d4171d7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2c98860f6c43df9884277600bd9295, user_id=f7df097897be44eb93dac9fb15a36547, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.051577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7dc69-fa3e-4c82-930b-b56d4171d7a2 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.065350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1065/2163] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:19 2022] PUT /identity/v3/projects/2a2c98860f6c43df9884277600bd9295/users/f7df097897be44eb93dac9fb15a36547/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:19.076366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ba163-6745-4182-8041-cb019788acfa None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.077277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ba163-6745-4182-8041-cb019788acfa None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.078853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ba163-6745-4182-8041-cb019788acfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.111128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-820ba163-6745-4182-8041-cb019788acfa None None] MFA Rules not processed for user `f7df097897be44eb93dac9fb15a36547`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:19.112369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-820ba163-6745-4182-8041-cb019788acfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:19.188936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1099/2164] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:19.193806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7dc69-fa3e-4c82-930b-b56d4171d7a2 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.268036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7dc69-fa3e-4c82-930b-b56d4171d7a2 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.272716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9ea3-57c0-4590-887b-3c328f4214f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.273371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9ea3-57c0-4590-887b-3c328f4214f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.273649 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9ea3-57c0-4590-887b-3c328f4214f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.273909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9ea3-57c0-4590-887b-3c328f4214f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.274601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b9ea3-57c0-4590-887b-3c328f4214f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.276515 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b9ea3-57c0-4590-887b-3c328f4214f6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.305291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1066/2165] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:19 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:19.310162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ba163-6745-4182-8041-cb019788acfa None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.325151 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ba163-6745-4182-8041-cb019788acfa None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.395919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87295010-bb94-4e96-bde2-4f91645f6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.396585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295010-bb94-4e96-bde2-4f91645f6517 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.396861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295010-bb94-4e96-bde2-4f91645f6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.397130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295010-bb94-4e96-bde2-4f91645f6517 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.397810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87295010-bb94-4e96-bde2-4f91645f6517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.399752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87295010-bb94-4e96-bde2-4f91645f6517 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.419306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1100/2166] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:19 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:19.431653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9ea3-57c0-4590-887b-3c328f4214f6 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.450196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9ea3-57c0-4590-887b-3c328f4214f6 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.455603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdd5dd-8e1f-4615-b095-d7911ef2b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.456347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd5dd-8e1f-4615-b095-d7911ef2b95c admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.456699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd5dd-8e1f-4615-b095-d7911ef2b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.457270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd5dd-8e1f-4615-b095-d7911ef2b95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.458089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdd5dd-8e1f-4615-b095-d7911ef2b95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.459962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdd5dd-8e1f-4615-b095-d7911ef2b95c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.476013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1067/2167] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:19.479551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87295010-bb94-4e96-bde2-4f91645f6517 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.491792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87295010-bb94-4e96-bde2-4f91645f6517 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.497365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ff1ec-15e6-44c0-94fb-e96224308068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.498319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ff1ec-15e6-44c0-94fb-e96224308068 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.499254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ff1ec-15e6-44c0-94fb-e96224308068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.499591 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ff1ec-15e6-44c0-94fb-e96224308068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.500324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ff1ec-15e6-44c0-94fb-e96224308068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.503134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ff1ec-15e6-44c0-94fb-e96224308068 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.512651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1101/2168] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:19.516721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdd5dd-8e1f-4615-b095-d7911ef2b95c admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.526516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdd5dd-8e1f-4615-b095-d7911ef2b95c admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.531163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d09a66-d5d5-42ca-a4e8-a60af8e433d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.532027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d09a66-d5d5-42ca-a4e8-a60af8e433d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.532346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d09a66-d5d5-42ca-a4e8-a60af8e433d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.532629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d09a66-d5d5-42ca-a4e8-a60af8e433d2 admin admin] PATH_INFO: `/v3/projects/4b9af445f1274c238dc86a592f80d538/users/02a7c2c57750420e974d1a75edf8d87e/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.547060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d09a66-d5d5-42ca-a4e8-a60af8e433d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9af445f1274c238dc86a592f80d538, user_id=02a7c2c57750420e974d1a75edf8d87e, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.549680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d09a66-d5d5-42ca-a4e8-a60af8e433d2 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.562573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1068/2169] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:19 2022] PUT /identity/v3/projects/4b9af445f1274c238dc86a592f80d538/users/02a7c2c57750420e974d1a75edf8d87e/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:19.576859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbcbe8-c5ea-40d1-8721-be03ff794af5 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.577153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbcbe8-c5ea-40d1-8721-be03ff794af5 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.577459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbcbe8-c5ea-40d1-8721-be03ff794af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.604239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-64bbcbe8-c5ea-40d1-8721-be03ff794af5 None None] MFA Rules not processed for user `02a7c2c57750420e974d1a75edf8d87e`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:19.605517 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-64bbcbe8-c5ea-40d1-8721-be03ff794af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:19.670080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1102/2170] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:19.678541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d09a66-d5d5-42ca-a4e8-a60af8e433d2 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.752871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d09a66-d5d5-42ca-a4e8-a60af8e433d2 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.758531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72df08-7bd3-4c1d-b607-61f9a5a67683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.759361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72df08-7bd3-4c1d-b607-61f9a5a67683 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.759863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72df08-7bd3-4c1d-b607-61f9a5a67683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.760191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72df08-7bd3-4c1d-b607-61f9a5a67683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.760886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72df08-7bd3-4c1d-b607-61f9a5a67683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.763538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72df08-7bd3-4c1d-b607-61f9a5a67683 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.798268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1069/2171] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:19 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:19.799769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbcbe8-c5ea-40d1-8721-be03ff794af5 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.818617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbcbe8-c5ea-40d1-8721-be03ff794af5 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.877965 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.883018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.883018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.883018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.883018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.883018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.907129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1103/2172] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:19 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:19.911118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72df08-7bd3-4c1d-b607-61f9a5a67683 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.922737 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.924894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:19.929708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72df08-7bd3-4c1d-b607-61f9a5a67683 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.935094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bdf13-0e96-496f-8939-7672b6f4ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.935808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bdf13-0e96-496f-8939-7672b6f4ef1c admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.936132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bdf13-0e96-496f-8939-7672b6f4ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.936404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bdf13-0e96-496f-8939-7672b6f4ef1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.937162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bdf13-0e96-496f-8939-7672b6f4ef1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.937867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765ace-14c9-4b58-bdf7-20df02083a46 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.938810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bdf13-0e96-496f-8939-7672b6f4ef1c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.943040 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.944274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.944274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.944656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] PATH_INFO: `/v3/users/ebfbf6599b9e4abf88400ca7d7a3cbab` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.946085 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebfbf6599b9e4abf88400ca7d7a3cbab)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.948100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:19.949659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1070/2173] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:19.953614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bdf13-0e96-496f-8939-7672b6f4ef1c admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:19.963062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bdf13-0e96-496f-8939-7672b6f4ef1c admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:19.968187 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3214f00-927e-47dd-9c6e-30e02ab6f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:19.969051 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3214f00-927e-47dd-9c6e-30e02ab6f622 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.969328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3214f00-927e-47dd-9c6e-30e02ab6f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.969601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3214f00-927e-47dd-9c6e-30e02ab6f622 admin admin] PATH_INFO: `/v3/projects/d1f49f2195cc4f98a7d98a9e4bdd7a14/users/9da82122d1c1421bbd640a3bd72fdb8a/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.987845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3214f00-927e-47dd-9c6e-30e02ab6f622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f49f2195cc4f98a7d98a9e4bdd7a14, user_id=9da82122d1c1421bbd640a3bd72fdb8a, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:19.991180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3214f00-927e-47dd-9c6e-30e02ab6f622 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.003096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfbf6599b9e4abf88400ca7d7a3cbab'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.006078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1071/2174] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:19 2022] PUT /identity/v3/projects/d1f49f2195cc4f98a7d98a9e4bdd7a14/users/9da82122d1c1421bbd640a3bd72fdb8a/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:20.010219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3214f00-927e-47dd-9c6e-30e02ab6f622 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:20.011264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfbf6599b9e4abf88400ca7d7a3cbab'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.024751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfbf6599b9e4abf88400ca7d7a3cbab'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.025587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfbf6599b9e4abf88400ca7d7a3cbab'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.042751 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-21f2d69c-bfd5-46fc-af98-42a04dd93ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfbf6599b9e4abf88400ca7d7a3cbab'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.055622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1104/2175] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:19 2022] DELETE /identity/v3/users/ebfbf6599b9e4abf88400ca7d7a3cbab => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:20.059982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99bc4b-4a50-4175-a8dc-8221de7b369c None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.060272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99bc4b-4a50-4175-a8dc-8221de7b369c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.060550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99bc4b-4a50-4175-a8dc-8221de7b369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.079836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ec99bc4b-4a50-4175-a8dc-8221de7b369c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:20.088675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3214f00-927e-47dd-9c6e-30e02ab6f622 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:20.089146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ec99bc4b-4a50-4175-a8dc-8221de7b369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.150188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:20.150826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.151348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.151629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.152359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:20.153952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.154185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1105/2176] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:20.165173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99bc4b-4a50-4175-a8dc-8221de7b369c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:20.166632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ec99bc4b-4a50-4175-a8dc-8221de7b369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.167871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1072/2177] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:20.171882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:20.173727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.187485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a0f67-a171-4641-8446-a4e00b2e5eda admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:20.194150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d42053-6a38-4011-84b9-b33155fa62bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:20.195147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42053-6a38-4011-84b9-b33155fa62bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.195500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42053-6a38-4011-84b9-b33155fa62bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.195844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42053-6a38-4011-84b9-b33155fa62bb admin admin] PATH_INFO: `/v3/projects/d1f49f2195cc4f98a7d98a9e4bdd7a14/users/9da82122d1c1421bbd640a3bd72fdb8a/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.197890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d42053-6a38-4011-84b9-b33155fa62bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f49f2195cc4f98a7d98a9e4bdd7a14, user_id=9da82122d1c1421bbd640a3bd72fdb8a, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:20.200564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d42053-6a38-4011-84b9-b33155fa62bb admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.211356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1073/2178] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:20 2022] PUT /identity/v3/projects/d1f49f2195cc4f98a7d98a9e4bdd7a14/users/9da82122d1c1421bbd640a3bd72fdb8a/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:20.223111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760231-f9e4-438f-bb4d-bbc61f0791a1 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.223401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760231-f9e4-438f-bb4d-bbc61f0791a1 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.223679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760231-f9e4-438f-bb4d-bbc61f0791a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.225608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99bc4b-4a50-4175-a8dc-8221de7b369c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:20.248994 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-4f760231-f9e4-438f-bb4d-bbc61f0791a1 None None] MFA Rules not processed for user `9da82122d1c1421bbd640a3bd72fdb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:20.250317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4f760231-f9e4-438f-bb4d-bbc61f0791a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.280748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e5738-073e-4bc8-b3ab-317eac9fb4af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:20.281399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e5738-073e-4bc8-b3ab-317eac9fb4af service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.281673 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e5738-073e-4bc8-b3ab-317eac9fb4af service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.281952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e5738-073e-4bc8-b3ab-317eac9fb4af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.325688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1074/2179] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:20.341547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f760231-f9e4-438f-bb4d-bbc61f0791a1 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:20.343083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e5738-073e-4bc8-b3ab-317eac9fb4af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:20.344566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4f760231-f9e4-438f-bb4d-bbc61f0791a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.344703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e5738-073e-4bc8-b3ab-317eac9fb4af service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.354404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1106/2180] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:20.399494 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f760231-f9e4-438f-bb4d-bbc61f0791a1 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:20.403826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:20.404440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.404768 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.405599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.415870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:20.417713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.429348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1075/2181] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:20.470830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e5738-073e-4bc8-b3ab-317eac9fb4af service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:20.488408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e5738-073e-4bc8-b3ab-317eac9fb4af service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:20.492476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:20.493199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.493603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.494030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.512621 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.572984 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:20.574421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.583926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1107/2182] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:20.633523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:20.635004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.663212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda59298-3864-4610-8b38-ed21382fc369 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:20.668894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:20.669742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.670009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.670288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] PATH_INFO: `/v3/projects/0c45a1a3ad744235a61a662ad49b94d3` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.671490 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c45a1a3ad744235a61a662ad49b94d3)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:20.673373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.721093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c45a1a3ad744235a61a662ad49b94d3', 'request_id': 'req-20727363-56be-4c3d-bd0a-d0896667e746'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.728732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c45a1a3ad744235a61a662ad49b94d3', 'request_id': 'req-20727363-56be-4c3d-bd0a-d0896667e746'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.734171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c45a1a3ad744235a61a662ad49b94d3', 'request_id': 'req-20727363-56be-4c3d-bd0a-d0896667e746'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.750182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] The token cache is being invalidate because project 0c45a1a3ad744235a61a662ad49b94d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:20.750573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.751351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.753022 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1076/2183] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:20 2022] DELETE /identity/v3/projects/0c45a1a3ad744235a61a662ad49b94d3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:20.757050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:20.768160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52f1fb-bff1-4193-ac06-d38f81c796e0 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:20.861225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:20.863974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.864353 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.864647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] PATH_INFO: `/v3/users/acf866baf2b84d01a1df68b83a8c75c1` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.866579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf866baf2b84d01a1df68b83a8c75c1)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:20.868552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.956006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf866baf2b84d01a1df68b83a8c75c1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.963253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf866baf2b84d01a1df68b83a8c75c1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.972950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf866baf2b84d01a1df68b83a8c75c1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.974316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf866baf2b84d01a1df68b83a8c75c1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:20.997846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f470491d-9f0b-4b91-a139-62c53f039963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf866baf2b84d01a1df68b83a8c75c1'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:21.004980 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1108/2184] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:20 2022] DELETE /identity/v3/users/acf866baf2b84d01a1df68b83a8c75c1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:21.289128 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:21.290597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:21.304424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20727363-56be-4c3d-bd0a-d0896667e746 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:21.365289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:21.366137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.366418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.366693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] PATH_INFO: `/v3/projects/711ae9beabc04634bd9aa4095568d347` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.367909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=711ae9beabc04634bd9aa4095568d347)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:21.369803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:21.412989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711ae9beabc04634bd9aa4095568d347', 'request_id': 'req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:21.419914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711ae9beabc04634bd9aa4095568d347', 'request_id': 'req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:21.426169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711ae9beabc04634bd9aa4095568d347', 'request_id': 'req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:21.436752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] The token cache is being invalidate because project 711ae9beabc04634bd9aa4095568d347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:21.437035 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:21.437647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-56beb31f-e96a-4cd0-8ce3-588b4b0bc33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:21.439195 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1077/2185] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:21 2022] DELETE /identity/v3/projects/711ae9beabc04634bd9aa4095568d347 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:21.444041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace7e3-3e44-4a85-baea-f2debb23f95e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.444332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace7e3-3e44-4a85-baea-f2debb23f95e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.444606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace7e3-3e44-4a85-baea-f2debb23f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.462475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-99ace7e3-3e44-4a85-baea-f2debb23f95e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:21.463747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-99ace7e3-3e44-4a85-baea-f2debb23f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:21.521630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1109/2186] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:21.529520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90563-a691-4688-9058-fa80dc5475a3 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.530342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90563-a691-4688-9058-fa80dc5475a3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.530626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90563-a691-4688-9058-fa80dc5475a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.549277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-4ef90563-a691-4688-9058-fa80dc5475a3 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:21.550730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4ef90563-a691-4688-9058-fa80dc5475a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:21.558580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1078/2187] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:21.562650 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ace7e3-3e44-4a85-baea-f2debb23f95e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:21.572059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ace7e3-3e44-4a85-baea-f2debb23f95e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:21.576595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:21.577235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.577511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.577784 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.578502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:21.578804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:21.580408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:21.591574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1110/2188] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:21.596691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90563-a691-4688-9058-fa80dc5475a3 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:21.605895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90563-a691-4688-9058-fa80dc5475a3 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:21.611118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe072898-5481-478b-93d3-c875f32cd4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:21.611761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072898-5481-478b-93d3-c875f32cd4bd admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.612043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072898-5481-478b-93d3-c875f32cd4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.612315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072898-5481-478b-93d3-c875f32cd4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.612999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe072898-5481-478b-93d3-c875f32cd4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:21.614892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe072898-5481-478b-93d3-c875f32cd4bd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:21.640898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1079/2189] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:21 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:21.644768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:21.655670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed174cc-5588-4f98-bd88-edfe88e3ff2e admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:21.709579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57063fd5-68b5-4ffa-b555-d5690a0548ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:21.710053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57063fd5-68b5-4ffa-b555-d5690a0548ce admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.710340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57063fd5-68b5-4ffa-b555-d5690a0548ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.710617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57063fd5-68b5-4ffa-b555-d5690a0548ce admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.711340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57063fd5-68b5-4ffa-b555-d5690a0548ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:21.713253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57063fd5-68b5-4ffa-b555-d5690a0548ce admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:21.732213 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1111/2190] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:21 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:21.738158 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe072898-5481-478b-93d3-c875f32cd4bd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:21.748196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe072898-5481-478b-93d3-c875f32cd4bd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:21.753323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44b66a-b3c3-4a96-aa8b-0b0f33445973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:21.753970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44b66a-b3c3-4a96-aa8b-0b0f33445973 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.754251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44b66a-b3c3-4a96-aa8b-0b0f33445973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.754527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44b66a-b3c3-4a96-aa8b-0b0f33445973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.755298 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44b66a-b3c3-4a96-aa8b-0b0f33445973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:21.756889 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44b66a-b3c3-4a96-aa8b-0b0f33445973 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:21.766950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1080/2191] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:21.770560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57063fd5-68b5-4ffa-b555-d5690a0548ce admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:21.780326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57063fd5-68b5-4ffa-b555-d5690a0548ce admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:21.784902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939a561-58e9-461e-8807-f589848600f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:21.785551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a561-58e9-461e-8807-f589848600f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.785862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a561-58e9-461e-8807-f589848600f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.786142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a561-58e9-461e-8807-f589848600f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.786863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939a561-58e9-461e-8807-f589848600f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:21.788465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939a561-58e9-461e-8807-f589848600f5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:21.798617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1112/2192] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:21.802398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44b66a-b3c3-4a96-aa8b-0b0f33445973 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:21.812505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44b66a-b3c3-4a96-aa8b-0b0f33445973 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:21.817102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8fefa-4857-4b2a-97a3-0f47052359b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:21.817951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8fefa-4857-4b2a-97a3-0f47052359b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.818236 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8fefa-4857-4b2a-97a3-0f47052359b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.818514 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8fefa-4857-4b2a-97a3-0f47052359b8 admin admin] PATH_INFO: `/v3/projects/893ea98f55f241e99df191cd2ce42a27/users/0e216fccfbdb4b5aa64dde93b4890e23/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.832486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8fefa-4857-4b2a-97a3-0f47052359b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893ea98f55f241e99df191cd2ce42a27, user_id=0e216fccfbdb4b5aa64dde93b4890e23, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:21.835159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8fefa-4857-4b2a-97a3-0f47052359b8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:21.846879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1081/2193] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:21 2022] PUT /identity/v3/projects/893ea98f55f241e99df191cd2ce42a27/users/0e216fccfbdb4b5aa64dde93b4890e23/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:21.856824 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a788565-2ec1-4eb5-a112-569b76f99e12 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:21.857112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a788565-2ec1-4eb5-a112-569b76f99e12 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:21.857411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a788565-2ec1-4eb5-a112-569b76f99e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:21.883934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-9a788565-2ec1-4eb5-a112-569b76f99e12 None None] MFA Rules not processed for user `0e216fccfbdb4b5aa64dde93b4890e23`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:21.885145 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9a788565-2ec1-4eb5-a112-569b76f99e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:21.951909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1113/2194] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:21.956288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8fefa-4857-4b2a-97a3-0f47052359b8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:22.017581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8fefa-4857-4b2a-97a3-0f47052359b8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:22.022187 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e098887-649e-478a-a614-d62549cee978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:22.022838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e098887-649e-478a-a614-d62549cee978 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.023148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e098887-649e-478a-a614-d62549cee978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.023424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e098887-649e-478a-a614-d62549cee978 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.024113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e098887-649e-478a-a614-d62549cee978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:22.025996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e098887-649e-478a-a614-d62549cee978 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:22.051898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1082/2195] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:21 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:22.055915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a788565-2ec1-4eb5-a112-569b76f99e12 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:22.066512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a788565-2ec1-4eb5-a112-569b76f99e12 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:22.123132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8bd9-f1e5-4519-a929-231f88c8da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:22.124063 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8bd9-f1e5-4519-a929-231f88c8da4a admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.124498 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8bd9-f1e5-4519-a929-231f88c8da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.124771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8bd9-f1e5-4519-a929-231f88c8da4a admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.125480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8bd9-f1e5-4519-a929-231f88c8da4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:22.127406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8bd9-f1e5-4519-a929-231f88c8da4a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:22.146663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1114/2196] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:22 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:22.150501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e098887-649e-478a-a614-d62549cee978 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:22.161235 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e098887-649e-478a-a614-d62549cee978 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:22.165887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebea10-82c6-43fa-a4e0-ad0eb26fbcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:22.166608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebea10-82c6-43fa-a4e0-ad0eb26fbcdf admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.166951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebea10-82c6-43fa-a4e0-ad0eb26fbcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.167330 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebea10-82c6-43fa-a4e0-ad0eb26fbcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.168121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebea10-82c6-43fa-a4e0-ad0eb26fbcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:22.169767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebea10-82c6-43fa-a4e0-ad0eb26fbcdf admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:22.181437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1083/2197] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:22.185620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8bd9-f1e5-4519-a929-231f88c8da4a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:22.195610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8bd9-f1e5-4519-a929-231f88c8da4a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:22.200153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356d35-e636-46fa-9a9e-7a06ed73465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:22.201089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356d35-e636-46fa-9a9e-7a06ed73465d admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.201370 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356d35-e636-46fa-9a9e-7a06ed73465d admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.201643 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356d35-e636-46fa-9a9e-7a06ed73465d admin admin] PATH_INFO: `/v3/projects/12dc4fa7e503430b82ad1b9045237b20/users/0b595708248f43648c18355bce2d7b90/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.215825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de356d35-e636-46fa-9a9e-7a06ed73465d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12dc4fa7e503430b82ad1b9045237b20, user_id=0b595708248f43648c18355bce2d7b90, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:22.219282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de356d35-e636-46fa-9a9e-7a06ed73465d admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:22.231495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1115/2198] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:22 2022] PUT /identity/v3/projects/12dc4fa7e503430b82ad1b9045237b20/users/0b595708248f43648c18355bce2d7b90/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:22.235867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebea10-82c6-43fa-a4e0-ad0eb26fbcdf admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:22.245654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebea10-82c6-43fa-a4e0-ad0eb26fbcdf admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:22.309617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1c730-076e-4f24-9f85-5986469bcf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:22.310668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c730-076e-4f24-9f85-5986469bcf59 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.310952 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c730-076e-4f24-9f85-5986469bcf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.311263 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1c730-076e-4f24-9f85-5986469bcf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.312029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1c730-076e-4f24-9f85-5986469bcf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:22.313654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1c730-076e-4f24-9f85-5986469bcf59 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:22.323670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1084/2199] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:22.327739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356d35-e636-46fa-9a9e-7a06ed73465d admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:22.337873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356d35-e636-46fa-9a9e-7a06ed73465d admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:22.343106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:22.343981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.344258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.344528 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] PATH_INFO: `/v3/projects/12dc4fa7e503430b82ad1b9045237b20/users/0b595708248f43648c18355bce2d7b90/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.346610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12dc4fa7e503430b82ad1b9045237b20, user_id=0b595708248f43648c18355bce2d7b90, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:22.349254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:22.360199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1116/2200] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:22 2022] PUT /identity/v3/projects/12dc4fa7e503430b82ad1b9045237b20/users/0b595708248f43648c18355bce2d7b90/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:22.370377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383f9a-886f-43a6-a6f5-836b8b950b57 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.370825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383f9a-886f-43a6-a6f5-836b8b950b57 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.370942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383f9a-886f-43a6-a6f5-836b8b950b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.397316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-59383f9a-886f-43a6-a6f5-836b8b950b57 None None] MFA Rules not processed for user `0b595708248f43648c18355bce2d7b90`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:22.398532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-59383f9a-886f-43a6-a6f5-836b8b950b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:22.465198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1085/2201] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:22.476719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:22.478399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:22.535843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e848-e1cc-42cc-a100-02b7e6b4d394 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:22.539422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520ecb5-aaa0-47be-b7fd-994581de81de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:22.540057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520ecb5-aaa0-47be-b7fd-994581de81de service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.540340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520ecb5-aaa0-47be-b7fd-994581de81de service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.540616 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520ecb5-aaa0-47be-b7fd-994581de81de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.549675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520ecb5-aaa0-47be-b7fd-994581de81de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:22.551389 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520ecb5-aaa0-47be-b7fd-994581de81de service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:22.560709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1117/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:23.139043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59383f9a-886f-43a6-a6f5-836b8b950b57 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:23.198269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59383f9a-886f-43a6-a6f5-836b8b950b57 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:23.202655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:23.203543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:23.203817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:23.204085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] PATH_INFO: `/v3/users/0e216fccfbdb4b5aa64dde93b4890e23` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:23.205275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e216fccfbdb4b5aa64dde93b4890e23)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:23.207217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:23.252175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e216fccfbdb4b5aa64dde93b4890e23'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.259295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e216fccfbdb4b5aa64dde93b4890e23'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.268369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e216fccfbdb4b5aa64dde93b4890e23'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.269043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e216fccfbdb4b5aa64dde93b4890e23'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.282182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e216fccfbdb4b5aa64dde93b4890e23'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.292931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1086/2203] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:23 2022] DELETE /identity/v3/users/0e216fccfbdb4b5aa64dde93b4890e23 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:23.298142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60b93d-f6b3-46b7-8931-6f6ca62b8841 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:23.298615 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60b93d-f6b3-46b7-8931-6f6ca62b8841 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:23.299004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60b93d-f6b3-46b7-8931-6f6ca62b8841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:23.325436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-bc60b93d-f6b3-46b7-8931-6f6ca62b8841 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:23.327425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bc60b93d-f6b3-46b7-8931-6f6ca62b8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:23.392866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1118/2204] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:23.402609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:23.404121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:23.462057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e882e30-a62e-4173-be57-dfdacd44f10f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:23.466102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca2eda-5cea-4cd4-b4d9-26538bc692ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:23.466833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca2eda-5cea-4cd4-b4d9-26538bc692ab service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:23.467775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca2eda-5cea-4cd4-b4d9-26538bc692ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:23.468052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca2eda-5cea-4cd4-b4d9-26538bc692ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:23.477361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca2eda-5cea-4cd4-b4d9-26538bc692ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:23.478817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca2eda-5cea-4cd4-b4d9-26538bc692ab service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:23.492975 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1087/2205] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:23.840112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60b93d-f6b3-46b7-8931-6f6ca62b8841 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:23.846368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bc60b93d-f6b3-46b7-8931-6f6ca62b8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:23.872476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60b93d-f6b3-46b7-8931-6f6ca62b8841 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:23.879963 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:23.881031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:23.881653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:23.882069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] PATH_INFO: `/v3/projects/893ea98f55f241e99df191cd2ce42a27` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:23.883849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=893ea98f55f241e99df191cd2ce42a27)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:23.886803 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:23.941632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893ea98f55f241e99df191cd2ce42a27', 'request_id': 'req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.949328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893ea98f55f241e99df191cd2ce42a27', 'request_id': 'req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.955590 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893ea98f55f241e99df191cd2ce42a27', 'request_id': 'req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.967140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] The token cache is being invalidate because project 893ea98f55f241e99df191cd2ce42a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:23.967939 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.968584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:23.970100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1119/2206] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:23 2022] DELETE /identity/v3/projects/893ea98f55f241e99df191cd2ce42a27 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:23.974230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca2eda-5cea-4cd4-b4d9-26538bc692ab service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:23.984034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca2eda-5cea-4cd4-b4d9-26538bc692ab service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:24.041184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:24.042059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:24.042338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:24.042607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] PATH_INFO: `/v3/users/0b595708248f43648c18355bce2d7b90` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:24.043825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b595708248f43648c18355bce2d7b90)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:24.046080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:24.096011 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b595708248f43648c18355bce2d7b90'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.103661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b595708248f43648c18355bce2d7b90'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.112759 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b595708248f43648c18355bce2d7b90'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.113375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b595708248f43648c18355bce2d7b90'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.128054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-fb937553-df98-406e-8d54-29ea7b5799b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b595708248f43648c18355bce2d7b90'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.136615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1088/2207] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:23 2022] DELETE /identity/v3/users/0b595708248f43648c18355bce2d7b90 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:24.491296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:24.493618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:24.508205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953fcb6-f7d3-49ae-adbf-a5a9d78d6ebf admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:24.584004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:24.584903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:24.585179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:24.585451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] PATH_INFO: `/v3/projects/12dc4fa7e503430b82ad1b9045237b20` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:24.586644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12dc4fa7e503430b82ad1b9045237b20)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:24.588569 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:24.645770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12dc4fa7e503430b82ad1b9045237b20', 'request_id': 'req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.654476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12dc4fa7e503430b82ad1b9045237b20', 'request_id': 'req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.660436 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12dc4fa7e503430b82ad1b9045237b20', 'request_id': 'req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.672055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] The token cache is being invalidate because project 12dc4fa7e503430b82ad1b9045237b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:24.672427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.673070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-48df28f0-10ad-4cd9-9a2d-fe7d39428d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:24.674584 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1120/2208] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:24 2022] DELETE /identity/v3/projects/12dc4fa7e503430b82ad1b9045237b20 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:24.680910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b34c72-b1c1-453d-9c23-ccf8f4b12a36 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:24.681408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b34c72-b1c1-453d-9c23-ccf8f4b12a36 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:24.681547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b34c72-b1c1-453d-9c23-ccf8f4b12a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:24.700199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-09b34c72-b1c1-453d-9c23-ccf8f4b12a36 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:24.701417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-09b34c72-b1c1-453d-9c23-ccf8f4b12a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:24.758003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1089/2209] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:24.766549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5192-92d2-4412-9605-ea43e50db410 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:24.766843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5192-92d2-4412-9605-ea43e50db410 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:24.767158 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5192-92d2-4412-9605-ea43e50db410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:24.784976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-97cc5192-92d2-4412-9605-ea43e50db410 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:24.786159 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-97cc5192-92d2-4412-9605-ea43e50db410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:24.793970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1121/2210] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:24.798490 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b34c72-b1c1-453d-9c23-ccf8f4b12a36 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:24.808205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b34c72-b1c1-453d-9c23-ccf8f4b12a36 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:24.813371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:24.814019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:24.814304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:24.814582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:24.815342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:24.815652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:24.817253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:24.828577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1090/2211] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:24.832798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5192-92d2-4412-9605-ea43e50db410 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:24.841764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5192-92d2-4412-9605-ea43e50db410 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:24.846319 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86be4a-abe6-4337-af98-701825a2dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:24.846987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86be4a-abe6-4337-af98-701825a2dd51 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:24.847272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86be4a-abe6-4337-af98-701825a2dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:24.847547 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86be4a-abe6-4337-af98-701825a2dd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:24.848227 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86be4a-abe6-4337-af98-701825a2dd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:24.850304 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86be4a-abe6-4337-af98-701825a2dd51 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:24.874895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1122/2212] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:24 2022] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:24.879270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:24.893033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311b85a-fd44-48e6-b91a-73529aed4d85 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:24.950739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35849f98-5caa-4ea0-8e35-dff640f693f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:24.951948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849f98-5caa-4ea0-8e35-dff640f693f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:24.952231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849f98-5caa-4ea0-8e35-dff640f693f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:24.952499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849f98-5caa-4ea0-8e35-dff640f693f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:24.953181 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35849f98-5caa-4ea0-8e35-dff640f693f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:24.955101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35849f98-5caa-4ea0-8e35-dff640f693f7 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:24.974202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1091/2213] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:24 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:24.978265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86be4a-abe6-4337-af98-701825a2dd51 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:24.988618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86be4a-abe6-4337-af98-701825a2dd51 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:24.993262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4015-f3c4-44d3-b569-522370ed6ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:24.993914 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4015-f3c4-44d3-b569-522370ed6ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:24.994197 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4015-f3c4-44d3-b569-522370ed6ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:24.994475 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4015-f3c4-44d3-b569-522370ed6ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:24.995245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae4015-f3c4-44d3-b569-522370ed6ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:24.996826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae4015-f3c4-44d3-b569-522370ed6ef7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.007347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1123/2214] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:25.010892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35849f98-5caa-4ea0-8e35-dff640f693f7 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.021112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35849f98-5caa-4ea0-8e35-dff640f693f7 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.025760 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd386cbf-559e-44bc-80f8-0324972199ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.026401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd386cbf-559e-44bc-80f8-0324972199ef admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.026687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd386cbf-559e-44bc-80f8-0324972199ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.026986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd386cbf-559e-44bc-80f8-0324972199ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.027713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd386cbf-559e-44bc-80f8-0324972199ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.029302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd386cbf-559e-44bc-80f8-0324972199ef admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.039499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1092/2215] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:25.043359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4015-f3c4-44d3-b569-522370ed6ef7 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.053383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4015-f3c4-44d3-b569-522370ed6ef7 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.057922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184cd1-f28b-4c75-a7d5-76d1c99380f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.058783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184cd1-f28b-4c75-a7d5-76d1c99380f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.059108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184cd1-f28b-4c75-a7d5-76d1c99380f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.059387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184cd1-f28b-4c75-a7d5-76d1c99380f5 admin admin] PATH_INFO: `/v3/projects/aba02c144ea949b6902e641f860374f6/users/28af4d4f39d7494cb4ba339efdcfd6ee/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.074114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5184cd1-f28b-4c75-a7d5-76d1c99380f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba02c144ea949b6902e641f860374f6, user_id=28af4d4f39d7494cb4ba339efdcfd6ee, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.077392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5184cd1-f28b-4c75-a7d5-76d1c99380f5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.090198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1124/2216] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:25 2022] PUT /identity/v3/projects/aba02c144ea949b6902e641f860374f6/users/28af4d4f39d7494cb4ba339efdcfd6ee/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:25.100406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b397c-e9c9-4001-9f9c-f8bcf2c7ce9e None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.100695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b397c-e9c9-4001-9f9c-f8bcf2c7ce9e None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.100972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b397c-e9c9-4001-9f9c-f8bcf2c7ce9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.128076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3f5b397c-e9c9-4001-9f9c-f8bcf2c7ce9e None None] MFA Rules not processed for user `28af4d4f39d7494cb4ba339efdcfd6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:25.129292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3f5b397c-e9c9-4001-9f9c-f8bcf2c7ce9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:25.190075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1093/2217] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:25.194424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184cd1-f28b-4c75-a7d5-76d1c99380f5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.254022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184cd1-f28b-4c75-a7d5-76d1c99380f5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.258737 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368358e4-07a6-4d83-8249-11538c3ba922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.259417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368358e4-07a6-4d83-8249-11538c3ba922 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.259703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368358e4-07a6-4d83-8249-11538c3ba922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.259981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368358e4-07a6-4d83-8249-11538c3ba922 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.261096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368358e4-07a6-4d83-8249-11538c3ba922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.262956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368358e4-07a6-4d83-8249-11538c3ba922 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.292913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1125/2218] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:25 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:25.300206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b397c-e9c9-4001-9f9c-f8bcf2c7ce9e None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.310119 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b397c-e9c9-4001-9f9c-f8bcf2c7ce9e None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.368105 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b145dc-9596-4122-9179-32e9d7a71507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.368796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b145dc-9596-4122-9179-32e9d7a71507 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.369075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b145dc-9596-4122-9179-32e9d7a71507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.369344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b145dc-9596-4122-9179-32e9d7a71507 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.370028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b145dc-9596-4122-9179-32e9d7a71507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.372098 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b145dc-9596-4122-9179-32e9d7a71507 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.393288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1094/2219] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:25 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:25.397076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368358e4-07a6-4d83-8249-11538c3ba922 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.407546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368358e4-07a6-4d83-8249-11538c3ba922 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.412264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9feb-e1e0-4fa6-a6d9-0f732b9b6c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.412917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9feb-e1e0-4fa6-a6d9-0f732b9b6c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.413215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9feb-e1e0-4fa6-a6d9-0f732b9b6c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.413512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc9feb-e1e0-4fa6-a6d9-0f732b9b6c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.414245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc9feb-e1e0-4fa6-a6d9-0f732b9b6c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.415867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc9feb-e1e0-4fa6-a6d9-0f732b9b6c19 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.430675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1126/2220] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:25.432294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b145dc-9596-4122-9179-32e9d7a71507 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.453214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b145dc-9596-4122-9179-32e9d7a71507 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.461663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118e7c-3746-4ec6-bfcc-7ff9dbb80a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.462574 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118e7c-3746-4ec6-bfcc-7ff9dbb80a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.462856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118e7c-3746-4ec6-bfcc-7ff9dbb80a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.463180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118e7c-3746-4ec6-bfcc-7ff9dbb80a96 admin admin] PATH_INFO: `/v3/projects/c6188ee465fd4d78bd881081b0963409/users/ce8f25080ef64fdc80760012a1f8e9cb/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.483412 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53118e7c-3746-4ec6-bfcc-7ff9dbb80a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6188ee465fd4d78bd881081b0963409, user_id=ce8f25080ef64fdc80760012a1f8e9cb, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.486060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53118e7c-3746-4ec6-bfcc-7ff9dbb80a96 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.501195 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1095/2221] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:25 2022] PUT /identity/v3/projects/c6188ee465fd4d78bd881081b0963409/users/ce8f25080ef64fdc80760012a1f8e9cb/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:25.512648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9feb-e1e0-4fa6-a6d9-0f732b9b6c19 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.522823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc9feb-e1e0-4fa6-a6d9-0f732b9b6c19 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.578843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f20dd1-b441-4718-9660-ba4faa1848de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.579550 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f20dd1-b441-4718-9660-ba4faa1848de admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.579830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f20dd1-b441-4718-9660-ba4faa1848de admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.580105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f20dd1-b441-4718-9660-ba4faa1848de admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.580825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f20dd1-b441-4718-9660-ba4faa1848de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.582492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f20dd1-b441-4718-9660-ba4faa1848de admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.595728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1127/2222] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:25.602405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118e7c-3746-4ec6-bfcc-7ff9dbb80a96 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.615249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118e7c-3746-4ec6-bfcc-7ff9dbb80a96 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.621105 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.621989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.622267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.622541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] PATH_INFO: `/v3/projects/c6188ee465fd4d78bd881081b0963409/users/ce8f25080ef64fdc80760012a1f8e9cb/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.625501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6188ee465fd4d78bd881081b0963409, user_id=ce8f25080ef64fdc80760012a1f8e9cb, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.628183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.638482 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1096/2223] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:25 2022] PUT /identity/v3/projects/c6188ee465fd4d78bd881081b0963409/users/ce8f25080ef64fdc80760012a1f8e9cb/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:25.648890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522bc0-dc4f-464c-a554-a6b0ff95b8c4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.649172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522bc0-dc4f-464c-a554-a6b0ff95b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.649455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32522bc0-dc4f-464c-a554-a6b0ff95b8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.676198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-32522bc0-dc4f-464c-a554-a6b0ff95b8c4 None None] MFA Rules not processed for user `ce8f25080ef64fdc80760012a1f8e9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:25.677459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-32522bc0-dc4f-464c-a554-a6b0ff95b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:25.753478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1128/2224] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:25.764017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:25.765782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:25.820587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1bf02-873f-4f1c-ad10-5d6bada2cae5 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:25.824202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e1fa-328a-4854-9490-662639aec066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:25.824827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e1fa-328a-4854-9490-662639aec066 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:25.825108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e1fa-328a-4854-9490-662639aec066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:25.825379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e1fa-328a-4854-9490-662639aec066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:25.834035 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1e1fa-328a-4854-9490-662639aec066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:25.835489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1e1fa-328a-4854-9490-662639aec066 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:25.845078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1097/2225] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:26.197888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32522bc0-dc4f-464c-a554-a6b0ff95b8c4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:26.259844 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32522bc0-dc4f-464c-a554-a6b0ff95b8c4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:26.265343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:26.266629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:26.267015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:26.267423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] PATH_INFO: `/v3/users/28af4d4f39d7494cb4ba339efdcfd6ee` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:26.268708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=28af4d4f39d7494cb4ba339efdcfd6ee)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:26.270593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:26.314427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28af4d4f39d7494cb4ba339efdcfd6ee'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.320938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28af4d4f39d7494cb4ba339efdcfd6ee'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.327344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28af4d4f39d7494cb4ba339efdcfd6ee'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.327945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28af4d4f39d7494cb4ba339efdcfd6ee'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.338990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28af4d4f39d7494cb4ba339efdcfd6ee'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.345144 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1129/2226] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:26 2022] DELETE /identity/v3/users/28af4d4f39d7494cb4ba339efdcfd6ee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:26.349566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b6d56-1b43-49d0-8119-1ba8b4492672 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:26.349851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b6d56-1b43-49d0-8119-1ba8b4492672 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:26.350127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b6d56-1b43-49d0-8119-1ba8b4492672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:26.367537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6c4b6d56-1b43-49d0-8119-1ba8b4492672 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:26.368709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6c4b6d56-1b43-49d0-8119-1ba8b4492672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:26.424456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1098/2227] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:26.434122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:26.435531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:26.490644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de267-7d55-42b1-8f74-f8b39e5c11bc admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:26.494295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44de8e-e527-4389-a8cb-12b6d9dda40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:26.494937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44de8e-e527-4389-a8cb-12b6d9dda40d service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:26.495248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44de8e-e527-4389-a8cb-12b6d9dda40d service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:26.495521 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44de8e-e527-4389-a8cb-12b6d9dda40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:26.506417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44de8e-e527-4389-a8cb-12b6d9dda40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:26.507879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44de8e-e527-4389-a8cb-12b6d9dda40d service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:26.518814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1130/2228] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:26.779675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b6d56-1b43-49d0-8119-1ba8b4492672 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:26.781152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6c4b6d56-1b43-49d0-8119-1ba8b4492672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:26.793917 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b6d56-1b43-49d0-8119-1ba8b4492672 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:26.799018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:26.800088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:26.800797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:26.801246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] PATH_INFO: `/v3/projects/aba02c144ea949b6902e641f860374f6` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:26.802628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba02c144ea949b6902e641f860374f6)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:26.804739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:26.859493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba02c144ea949b6902e641f860374f6', 'request_id': 'req-8239fd7e-810e-4126-8bc1-39349d906be8'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.867648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba02c144ea949b6902e641f860374f6', 'request_id': 'req-8239fd7e-810e-4126-8bc1-39349d906be8'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.873282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba02c144ea949b6902e641f860374f6', 'request_id': 'req-8239fd7e-810e-4126-8bc1-39349d906be8'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.885736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] The token cache is being invalidate because project aba02c144ea949b6902e641f860374f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:26.886025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.886912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:26.888850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1099/2229] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:26 2022] DELETE /identity/v3/projects/aba02c144ea949b6902e641f860374f6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:26.893681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44de8e-e527-4389-a8cb-12b6d9dda40d service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:26.903153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44de8e-e527-4389-a8cb-12b6d9dda40d service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:26.961349 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:26.962532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:26.962816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:26.963216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] PATH_INFO: `/v3/users/ce8f25080ef64fdc80760012a1f8e9cb` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:26.964325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8f25080ef64fdc80760012a1f8e9cb)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:26.966298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.010037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8f25080ef64fdc80760012a1f8e9cb'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.017143 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8f25080ef64fdc80760012a1f8e9cb'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.024346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8f25080ef64fdc80760012a1f8e9cb'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.024917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8f25080ef64fdc80760012a1f8e9cb'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.037073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1a186ac7-66d2-4a52-8ed4-ecb3849ce146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8f25080ef64fdc80760012a1f8e9cb'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.043221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1131/2230] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:26 2022] DELETE /identity/v3/users/ce8f25080ef64fdc80760012a1f8e9cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:27.311885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:27.313904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:27.327449 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239fd7e-810e-4126-8bc1-39349d906be8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:27.384779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:27.385681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.385962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.386237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] PATH_INFO: `/v3/projects/c6188ee465fd4d78bd881081b0963409` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.387462 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6188ee465fd4d78bd881081b0963409)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:27.389369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.434463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6188ee465fd4d78bd881081b0963409', 'request_id': 'req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.442016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6188ee465fd4d78bd881081b0963409', 'request_id': 'req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.447348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6188ee465fd4d78bd881081b0963409', 'request_id': 'req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.457885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] The token cache is being invalidate because project c6188ee465fd4d78bd881081b0963409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:27.458172 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.458845 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-77a1e5cd-66a9-497e-9ffc-4a7edd9c3090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.460528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1100/2231] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:27 2022] DELETE /identity/v3/projects/c6188ee465fd4d78bd881081b0963409 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:27.465670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f57a5-2acd-4820-b587-d77b88a81ee7 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.465962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f57a5-2acd-4820-b587-d77b88a81ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.466247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f57a5-2acd-4820-b587-d77b88a81ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.483856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-337f57a5-2acd-4820-b587-d77b88a81ee7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:27.485545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-337f57a5-2acd-4820-b587-d77b88a81ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:27.545127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1132/2232] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:27.553768 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbed3c5-86d7-448c-afb2-8e8f2b510e5f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.554025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbed3c5-86d7-448c-afb2-8e8f2b510e5f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.554303 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbed3c5-86d7-448c-afb2-8e8f2b510e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.572869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ccbed3c5-86d7-448c-afb2-8e8f2b510e5f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:27.574049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ccbed3c5-86d7-448c-afb2-8e8f2b510e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:27.583635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1101/2233] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:27.587767 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f57a5-2acd-4820-b587-d77b88a81ee7 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:27.597465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f57a5-2acd-4820-b587-d77b88a81ee7 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:27.602097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:27.602747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.603055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.603333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.604053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:27.604357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:27.605924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.617792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1133/2234] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:27.622356 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbed3c5-86d7-448c-afb2-8e8f2b510e5f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:27.631885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbed3c5-86d7-448c-afb2-8e8f2b510e5f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:27.637173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c7095-244f-4938-b2d4-3ba31333304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:27.637881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7095-244f-4938-b2d4-3ba31333304c admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.638165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7095-244f-4938-b2d4-3ba31333304c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.638444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7095-244f-4938-b2d4-3ba31333304c admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.639165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c7095-244f-4938-b2d4-3ba31333304c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:27.641250 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c7095-244f-4938-b2d4-3ba31333304c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.667600 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1102/2235] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:27 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:27.672606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:27.685057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de9a80-bdc6-4b50-9732-cc205fa0a2b5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:27.746014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631dfc6-0c36-4c83-8f33-d33e932cc8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:27.746779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631dfc6-0c36-4c83-8f33-d33e932cc8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.747177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631dfc6-0c36-4c83-8f33-d33e932cc8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.747622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631dfc6-0c36-4c83-8f33-d33e932cc8bc admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.748416 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631dfc6-0c36-4c83-8f33-d33e932cc8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:27.753446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631dfc6-0c36-4c83-8f33-d33e932cc8bc admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.771016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1134/2236] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:27 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:27.775292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c7095-244f-4938-b2d4-3ba31333304c admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:27.787067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c7095-244f-4938-b2d4-3ba31333304c admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:27.802194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b3167-1174-44a8-b710-0fc277167950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:27.803121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3167-1174-44a8-b710-0fc277167950 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.803472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3167-1174-44a8-b710-0fc277167950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.803881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3167-1174-44a8-b710-0fc277167950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.804777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b3167-1174-44a8-b710-0fc277167950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:27.806697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b3167-1174-44a8-b710-0fc277167950 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.822251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1103/2237] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:27.826243 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631dfc6-0c36-4c83-8f33-d33e932cc8bc admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:27.837031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631dfc6-0c36-4c83-8f33-d33e932cc8bc admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:27.844490 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:27.845316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.845316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.846081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.853254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:27.855774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.871692 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1135/2238] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:27.876532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b3167-1174-44a8-b710-0fc277167950 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:27.891712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b3167-1174-44a8-b710-0fc277167950 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:27.893425 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:27.896226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:27.897821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89510530-ca59-44c9-9d3e-b65757c6ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:27.898875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510530-ca59-44c9-9d3e-b65757c6ab05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.899366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510530-ca59-44c9-9d3e-b65757c6ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.899647 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510530-ca59-44c9-9d3e-b65757c6ab05 admin admin] PATH_INFO: `/v3/projects/b477761e7d5b43118af79e7a3f9255a5/users/39b49d7e5ba84894a81c8c659a070e51/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.910417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918b31e-b122-4167-9f6c-11bfb09a68ae admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:27.915869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:27.916752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.917037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.917147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89510530-ca59-44c9-9d3e-b65757c6ab05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b477761e7d5b43118af79e7a3f9255a5, user_id=39b49d7e5ba84894a81c8c659a070e51, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:27.917310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] PATH_INFO: `/v3/users/f7df097897be44eb93dac9fb15a36547` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.918684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7df097897be44eb93dac9fb15a36547)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:27.919730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89510530-ca59-44c9-9d3e-b65757c6ab05 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.920677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:27.945739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1104/2239] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:27 2022] PUT /identity/v3/projects/b477761e7d5b43118af79e7a3f9255a5/users/39b49d7e5ba84894a81c8c659a070e51/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:27.956285 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce2da-1ffc-4d20-94d5-33c77ffc8d21 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:27.956835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce2da-1ffc-4d20-94d5-33c77ffc8d21 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:27.957185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce2da-1ffc-4d20-94d5-33c77ffc8d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:27.986830 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-fc2ce2da-1ffc-4d20-94d5-33c77ffc8d21 None None] MFA Rules not processed for user `39b49d7e5ba84894a81c8c659a070e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:27.988964 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7df097897be44eb93dac9fb15a36547'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:27.989359 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fc2ce2da-1ffc-4d20-94d5-33c77ffc8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:28.009147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7df097897be44eb93dac9fb15a36547'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.021279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7df097897be44eb93dac9fb15a36547'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.022758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7df097897be44eb93dac9fb15a36547'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.049577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-795f1dbe-f4f5-4824-97bd-0cfe6645f2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7df097897be44eb93dac9fb15a36547'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.059350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1136/2240] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:27 2022] DELETE /identity/v3/users/f7df097897be44eb93dac9fb15a36547 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:28.060974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d1de-0782-4b5e-be1e-6e25cf40720e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:28.061310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d1de-0782-4b5e-be1e-6e25cf40720e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:28.061600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d1de-0782-4b5e-be1e-6e25cf40720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:28.077375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1105/2241] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:28.086503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fbc4d1de-0782-4b5e-be1e-6e25cf40720e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:28.088242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fbc4d1de-0782-4b5e-be1e-6e25cf40720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:28.091820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce2da-1ffc-4d20-94d5-33c77ffc8d21 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:28.093386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fc2ce2da-1ffc-4d20-94d5-33c77ffc8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:28.167129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce2da-1ffc-4d20-94d5-33c77ffc8d21 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:28.169799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1137/2242] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:28.180833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4d1de-0782-4b5e-be1e-6e25cf40720e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:28.182270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fbc4d1de-0782-4b5e-be1e-6e25cf40720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:28.223592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f939f-c0f6-49de-8a62-662ec86cf734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:28.224788 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f939f-c0f6-49de-8a62-662ec86cf734 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:28.225289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f939f-c0f6-49de-8a62-662ec86cf734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:28.225762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f939f-c0f6-49de-8a62-662ec86cf734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:28.249365 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4d1de-0782-4b5e-be1e-6e25cf40720e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:28.262986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:28.264036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:28.264368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:28.264674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:28.276670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:28.278114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:28.288899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f939f-c0f6-49de-8a62-662ec86cf734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:28.290271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f939f-c0f6-49de-8a62-662ec86cf734 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:28.291349 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1138/2243] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:28.302680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1106/2244] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:28.324200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:28.326956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:28.341120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511ceda-2fe3-46eb-9f5b-2652d44a0d2e service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:28.347946 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:28.349301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:28.349585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:28.351481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] PATH_INFO: `/v3/users/39b49d7e5ba84894a81c8c659a070e51` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:28.351913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b49d7e5ba84894a81c8c659a070e51)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:28.354608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:28.420230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b49d7e5ba84894a81c8c659a070e51'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.428447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b49d7e5ba84894a81c8c659a070e51'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.436957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b49d7e5ba84894a81c8c659a070e51'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.438430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b49d7e5ba84894a81c8c659a070e51'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.460126 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b49d7e5ba84894a81c8c659a070e51'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.467453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1139/2245] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:28 2022] DELETE /identity/v3/users/39b49d7e5ba84894a81c8c659a070e51 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:28.472390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db8f1-f976-40f0-a81e-2842a6c47b2a None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:28.472667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db8f1-f976-40f0-a81e-2842a6c47b2a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:28.472941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db8f1-f976-40f0-a81e-2842a6c47b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:28.491403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5f4db8f1-f976-40f0-a81e-2842a6c47b2a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:28.492598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5f4db8f1-f976-40f0-a81e-2842a6c47b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:28.571192 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1107/2246] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:28.581016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:28.582626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:28.617693 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db8f1-f976-40f0-a81e-2842a6c47b2a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:28.619217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5f4db8f1-f976-40f0-a81e-2842a6c47b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:28.641675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db8f1-f976-40f0-a81e-2842a6c47b2a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:28.651399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:28.652266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:28.652544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:28.652815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] PATH_INFO: `/v3/projects/2a2c98860f6c43df9884277600bd9295` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:28.655045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2c98860f6c43df9884277600bd9295)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:28.657322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:28.668169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898da97-b07f-44fa-8457-c86be6785651 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:28.682608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb166a-0cdf-4041-b662-b8d663223bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:28.682608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb166a-0cdf-4041-b662-b8d663223bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:28.682608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb166a-0cdf-4041-b662-b8d663223bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:28.682608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb166a-0cdf-4041-b662-b8d663223bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:28.694850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb166a-0cdf-4041-b662-b8d663223bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:28.696355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb166a-0cdf-4041-b662-b8d663223bd3 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:28.707854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1140/2247] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:28.711632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2c98860f6c43df9884277600bd9295', 'request_id': 'req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.720545 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2c98860f6c43df9884277600bd9295', 'request_id': 'req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.726664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2c98860f6c43df9884277600bd9295', 'request_id': 'req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.752639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] The token cache is being invalidate because project 2a2c98860f6c43df9884277600bd9295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:28.752639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.752862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.754556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1108/2248] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:28 2022] DELETE /identity/v3/projects/2a2c98860f6c43df9884277600bd9295 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:28.758761 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb166a-0cdf-4041-b662-b8d663223bd3 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:28.769056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb166a-0cdf-4041-b662-b8d663223bd3 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:28.861526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:28.862866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:28.863405 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:28.863877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] PATH_INFO: `/v3/users/02a7c2c57750420e974d1a75edf8d87e` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:28.865902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a7c2c57750420e974d1a75edf8d87e)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:28.868088 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:28.920234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a7c2c57750420e974d1a75edf8d87e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.928541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a7c2c57750420e974d1a75edf8d87e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.937192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a7c2c57750420e974d1a75edf8d87e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.938648 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a7c2c57750420e974d1a75edf8d87e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.950925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ba5fc251-84db-480e-9e9e-99f75c018045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a7c2c57750420e974d1a75edf8d87e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:28.963215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1141/2249] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:28 2022] DELETE /identity/v3/users/02a7c2c57750420e974d1a75edf8d87e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:29.075766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.079266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:29.104914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ab778-4ea9-473a-bbb3-afa50b2c0fa9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:29.212002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:29.212842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.212842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.213388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] PATH_INFO: `/v3/projects/b477761e7d5b43118af79e7a3f9255a5` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.214948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b477761e7d5b43118af79e7a3f9255a5)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:29.218882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:29.278234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b477761e7d5b43118af79e7a3f9255a5', 'request_id': 'req-bfed14a6-e34a-4fbc-b52e-0273053dd189'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.286323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b477761e7d5b43118af79e7a3f9255a5', 'request_id': 'req-bfed14a6-e34a-4fbc-b52e-0273053dd189'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.292620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b477761e7d5b43118af79e7a3f9255a5', 'request_id': 'req-bfed14a6-e34a-4fbc-b52e-0273053dd189'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.305132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] The token cache is being invalidate because project b477761e7d5b43118af79e7a3f9255a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:29.305418 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.306104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-bfed14a6-e34a-4fbc-b52e-0273053dd189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.307746 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1109/2250] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:29 2022] DELETE /identity/v3/projects/b477761e7d5b43118af79e7a3f9255a5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:29.314039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2795f08-d0b6-4009-a52c-1ccc80fa9147 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.314332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2795f08-d0b6-4009-a52c-1ccc80fa9147 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.314616 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2795f08-d0b6-4009-a52c-1ccc80fa9147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.336705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d2795f08-d0b6-4009-a52c-1ccc80fa9147 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:29.338566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d2795f08-d0b6-4009-a52c-1ccc80fa9147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:29.400746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1142/2251] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:29.410674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8ea37-656f-42c4-821a-1395b03bc1c2 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.411230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8ea37-656f-42c4-821a-1395b03bc1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.411703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8ea37-656f-42c4-821a-1395b03bc1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.434101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-01a8ea37-656f-42c4-821a-1395b03bc1c2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:29.435386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-01a8ea37-656f-42c4-821a-1395b03bc1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:29.444145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1110/2252] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:29.448921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2795f08-d0b6-4009-a52c-1ccc80fa9147 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.460108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2795f08-d0b6-4009-a52c-1ccc80fa9147 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:29.464909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:29.465636 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.465921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.466193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.466914 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:29.467259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:29.468907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:29.480740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1143/2253] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:29.485716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8ea37-656f-42c4-821a-1395b03bc1c2 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.494812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8ea37-656f-42c4-821a-1395b03bc1c2 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:29.499426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25556fc-5071-48b0-b4a3-ec6db5a04c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:29.500156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25556fc-5071-48b0-b4a3-ec6db5a04c10 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.500944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25556fc-5071-48b0-b4a3-ec6db5a04c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.501232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25556fc-5071-48b0-b4a3-ec6db5a04c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.502054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25556fc-5071-48b0-b4a3-ec6db5a04c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:29.504074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25556fc-5071-48b0-b4a3-ec6db5a04c10 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:29.531690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1111/2254] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:29 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:29.536352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.546574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bee75-cbf6-4f87-baf2-232b8bc5a89b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:29.614577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151076a-91d6-404b-9e09-bae5c1bf4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:29.615281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151076a-91d6-404b-9e09-bae5c1bf4833 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.615571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151076a-91d6-404b-9e09-bae5c1bf4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.615849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151076a-91d6-404b-9e09-bae5c1bf4833 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.616543 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151076a-91d6-404b-9e09-bae5c1bf4833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:29.618479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151076a-91d6-404b-9e09-bae5c1bf4833 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:29.656699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1144/2255] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:29 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:29.660856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25556fc-5071-48b0-b4a3-ec6db5a04c10 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.674040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25556fc-5071-48b0-b4a3-ec6db5a04c10 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:29.684118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8441-9cb0-44ac-90f0-321d342b1d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:29.685427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8441-9cb0-44ac-90f0-321d342b1d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.685621 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8441-9cb0-44ac-90f0-321d342b1d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.686032 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8441-9cb0-44ac-90f0-321d342b1d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.686989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f8441-9cb0-44ac-90f0-321d342b1d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:29.689354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f8441-9cb0-44ac-90f0-321d342b1d1a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:29.705173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1112/2256] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:29.706665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151076a-91d6-404b-9e09-bae5c1bf4833 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.717633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151076a-91d6-404b-9e09-bae5c1bf4833 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:29.724233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:29.725008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.725479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.725812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.726553 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:29.728224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:29.740535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1145/2257] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:29.745028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8441-9cb0-44ac-90f0-321d342b1d1a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.756545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.759163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:29.760248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f8441-9cb0-44ac-90f0-321d342b1d1a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:29.772174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a47f87-58cc-4879-9c0e-2e1ae57eadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:29.773471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47f87-58cc-4879-9c0e-2e1ae57eadd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.773899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47f87-58cc-4879-9c0e-2e1ae57eadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.774282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47f87-58cc-4879-9c0e-2e1ae57eadd5 admin admin] PATH_INFO: `/v3/projects/5221a00ef39c428cbaa0d82d6880d65a/users/4d0f40741bfe4f96b10776f0677208c4/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.784276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99afca-a3d4-4197-bdcb-f6b55ff63627 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:29.789380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:29.790383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.790654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.790931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] PATH_INFO: `/v3/projects/4b9af445f1274c238dc86a592f80d538` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.792283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a47f87-58cc-4879-9c0e-2e1ae57eadd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5221a00ef39c428cbaa0d82d6880d65a, user_id=4d0f40741bfe4f96b10776f0677208c4, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:29.792519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9af445f1274c238dc86a592f80d538)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:29.794838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:29.796122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a47f87-58cc-4879-9c0e-2e1ae57eadd5 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:29.815854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1113/2258] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:29 2022] PUT /identity/v3/projects/5221a00ef39c428cbaa0d82d6880d65a/users/4d0f40741bfe4f96b10776f0677208c4/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:29.824826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2cbbe-b6dd-41a5-95d9-28b9b75a2f17 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:29.825199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2cbbe-b6dd-41a5-95d9-28b9b75a2f17 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:29.825587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2cbbe-b6dd-41a5-95d9-28b9b75a2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:29.861492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9af445f1274c238dc86a592f80d538', 'request_id': 'req-3151e37b-afcd-4559-ae20-6ce86774bc25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.870915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9af445f1274c238dc86a592f80d538', 'request_id': 'req-3151e37b-afcd-4559-ae20-6ce86774bc25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.881237 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9af445f1274c238dc86a592f80d538', 'request_id': 'req-3151e37b-afcd-4559-ae20-6ce86774bc25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.891326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e8d2cbbe-b6dd-41a5-95d9-28b9b75a2f17 None None] MFA Rules not processed for user `4d0f40741bfe4f96b10776f0677208c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:29.892806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e8d2cbbe-b6dd-41a5-95d9-28b9b75a2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:29.894743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] The token cache is being invalidate because project 4b9af445f1274c238dc86a592f80d538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:29.895268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.896056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:29.897938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1146/2259] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:29 2022] DELETE /identity/v3/projects/4b9af445f1274c238dc86a592f80d538 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:29.911291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:29.914090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:30.009332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1114/2260] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:30.010868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2cbbe-b6dd-41a5-95d9-28b9b75a2f17 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:30.012862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e8d2cbbe-b6dd-41a5-95d9-28b9b75a2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:30.017005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151e37b-afcd-4559-ae20-6ce86774bc25 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:30.022902 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:30.029014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:30.029340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:30.029549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] PATH_INFO: `/v3/users/9da82122d1c1421bbd640a3bd72fdb8a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:30.031037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da82122d1c1421bbd640a3bd72fdb8a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:30.033541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:30.046267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2cbbe-b6dd-41a5-95d9-28b9b75a2f17 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:30.053536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:30.054681 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:30.054984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:30.055252 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] PATH_INFO: `/v3/users/e7e31bed346e408e8499bcc6a3397a82` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:30.056756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e31bed346e408e8499bcc6a3397a82)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:30.058754 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:30.099502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da82122d1c1421bbd640a3bd72fdb8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.108089 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da82122d1c1421bbd640a3bd72fdb8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.117612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da82122d1c1421bbd640a3bd72fdb8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.118661 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da82122d1c1421bbd640a3bd72fdb8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.124164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e31bed346e408e8499bcc6a3397a82'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.132251 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e31bed346e408e8499bcc6a3397a82'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.134245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da82122d1c1421bbd640a3bd72fdb8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.141790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1147/2261] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:29 2022] DELETE /identity/v3/users/9da82122d1c1421bbd640a3bd72fdb8a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:30.141961 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e31bed346e408e8499bcc6a3397a82'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.142633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e31bed346e408e8499bcc6a3397a82'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.145922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:30.147234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:30.157956 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e31bed346e408e8499bcc6a3397a82'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.164576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1115/2262] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:30 2022] DELETE /identity/v3/users/e7e31bed346e408e8499bcc6a3397a82 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:30.235959 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da949f3d-a74d-4d55-889c-e23b16dc7e83 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:30.317847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:30.320205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:30.320564 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:30.320848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:30.323506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:30.449833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:30.452821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:30.476117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1148/2263] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:30.545205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:30.547574 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:30.681080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be52b-957c-46a9-972d-3b8f0ed0a209 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:30.686948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:30.688762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:30.689232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:30.689501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] PATH_INFO: `/v3/projects/e62efa049c3d42a58322385ec167719c` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:30.691665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62efa049c3d42a58322385ec167719c)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:30.694180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:30.752327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:30.756417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:30.779669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83e295-e02d-4edc-941f-9164b11370d7 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:30.791406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62efa049c3d42a58322385ec167719c', 'request_id': 'req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.799750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62efa049c3d42a58322385ec167719c', 'request_id': 'req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.806669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62efa049c3d42a58322385ec167719c', 'request_id': 'req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.820617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] The token cache is being invalidate because project e62efa049c3d42a58322385ec167719c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:30.820910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.821579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-ee21c95c-65c4-4aab-b924-dbb1a48c22a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.823640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1116/2264] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:30 2022] DELETE /identity/v3/projects/e62efa049c3d42a58322385ec167719c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:30.829084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9629-df54-4564-9c87-e9baef2f1a11 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:30.829550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9629-df54-4564-9c87-e9baef2f1a11 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:30.829769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af9629-df54-4564-9c87-e9baef2f1a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:30.845019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:30.845896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:30.846183 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:30.846457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] PATH_INFO: `/v3/projects/d1f49f2195cc4f98a7d98a9e4bdd7a14` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:30.847739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f49f2195cc4f98a7d98a9e4bdd7a14)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:30.849822 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:30.870459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-14af9629-df54-4564-9c87-e9baef2f1a11 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:30.871734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-14af9629-df54-4564-9c87-e9baef2f1a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:30.899601 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1117/2265] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:30.901130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21128ce-fc43-46b4-bd3b-d131b34a632c None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:30.901426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21128ce-fc43-46b4-bd3b-d131b34a632c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:30.901741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21128ce-fc43-46b4-bd3b-d131b34a632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:30.924749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f49f2195cc4f98a7d98a9e4bdd7a14', 'request_id': 'req-13806535-3dce-4238-acd1-6846d8695fb6'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.932406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d21128ce-fc43-46b4-bd3b-d131b34a632c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:30.933627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d21128ce-fc43-46b4-bd3b-d131b34a632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:30.934362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f49f2195cc4f98a7d98a9e4bdd7a14', 'request_id': 'req-13806535-3dce-4238-acd1-6846d8695fb6'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.942013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f49f2195cc4f98a7d98a9e4bdd7a14', 'request_id': 'req-13806535-3dce-4238-acd1-6846d8695fb6'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.954979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] The token cache is being invalidate because project d1f49f2195cc4f98a7d98a9e4bdd7a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:30.955349 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.956073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-13806535-3dce-4238-acd1-6846d8695fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:30.957920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1149/2266] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:30 2022] DELETE /identity/v3/projects/d1f49f2195cc4f98a7d98a9e4bdd7a14 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:30.964586 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147779-c860-4554-bced-7f377fde1561 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:30.964804 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147779-c860-4554-bced-7f377fde1561 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:30.965355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147779-c860-4554-bced-7f377fde1561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:30.988617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-25147779-c860-4554-bced-7f377fde1561 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:30.989864 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-25147779-c860-4554-bced-7f377fde1561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:31.003317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1118/2267] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:31.007674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21128ce-fc43-46b4-bd3b-d131b34a632c None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.018132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21128ce-fc43-46b4-bd3b-d131b34a632c None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.023669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.024353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.024638 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.024918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.025641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:31.025954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.027662 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.039720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1119/2268] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:46:31.044066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.054710 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07338d-2bee-43d3-abd6-920a3eff8d8d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.059707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d6910-e4cf-4957-adee-9c2f244a51f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.060864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d6910-e4cf-4957-adee-9c2f244a51f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.061153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d6910-e4cf-4957-adee-9c2f244a51f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.061433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d6910-e4cf-4957-adee-9c2f244a51f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.062130 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d6910-e4cf-4957-adee-9c2f244a51f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.065606 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d6910-e4cf-4957-adee-9c2f244a51f8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.072309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1150/2269] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:31.081095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f365f2-6a0c-47ce-8f4d-0b5317d6a2a8 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.081387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f365f2-6a0c-47ce-8f4d-0b5317d6a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.081665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f365f2-6a0c-47ce-8f4d-0b5317d6a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.104172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-e8f365f2-6a0c-47ce-8f4d-0b5317d6a2a8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:31.107442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e8f365f2-6a0c-47ce-8f4d-0b5317d6a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:31.117220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1120/2270] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:31 2022] POST /identity/v3/projects => generated 403 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:31.119069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1151/2271] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:31.122828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d6910-e4cf-4957-adee-9c2f244a51f8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.122998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f365f2-6a0c-47ce-8f4d-0b5317d6a2a8 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.132917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f365f2-6a0c-47ce-8f4d-0b5317d6a2a8 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.204342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.205670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d6910-e4cf-4957-adee-9c2f244a51f8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.206175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.206443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.206773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.207696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:31.208369 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.210081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.210902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772eb1-2223-40b0-ba8f-e7bef9ce1f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.211595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772eb1-2223-40b0-ba8f-e7bef9ce1f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.211882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772eb1-2223-40b0-ba8f-e7bef9ce1f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.212162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772eb1-2223-40b0-ba8f-e7bef9ce1f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.212853 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11772eb1-2223-40b0-ba8f-e7bef9ce1f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.214802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11772eb1-2223-40b0-ba8f-e7bef9ce1f8b admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.222686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1152/2272] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:31.227492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.239371 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e5d40-2e29-47ea-b3c7-6690b0f57979 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.243001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1121/2273] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:31 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:31.244258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772eb1-2223-40b0-ba8f-e7bef9ce1f8b admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.251433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9938-7470-4c54-8869-8b2166ef7ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.252100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9938-7470-4c54-8869-8b2166ef7ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.252381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9938-7470-4c54-8869-8b2166ef7ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.252661 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9938-7470-4c54-8869-8b2166ef7ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.253356 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9938-7470-4c54-8869-8b2166ef7ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.255293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9938-7470-4c54-8869-8b2166ef7ce5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.256052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772eb1-2223-40b0-ba8f-e7bef9ce1f8b admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.266481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd84a4-2132-42c0-930b-2998bda5bca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.267420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd84a4-2132-42c0-930b-2998bda5bca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.268218 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd84a4-2132-42c0-930b-2998bda5bca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.268657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd84a4-2132-42c0-930b-2998bda5bca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.269729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd84a4-2132-42c0-930b-2998bda5bca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.271816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd84a4-2132-42c0-930b-2998bda5bca1 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.285690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1122/2274] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:31.286721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd84a4-2132-42c0-930b-2998bda5bca1 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.288471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1153/2275] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:31 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:31.292137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9938-7470-4c54-8869-8b2166ef7ce5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.296510 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd84a4-2132-42c0-930b-2998bda5bca1 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.353422 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95828d22-8fc1-4325-abed-76c6aaf6e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.354092 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95828d22-8fc1-4325-abed-76c6aaf6e529 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.354368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95828d22-8fc1-4325-abed-76c6aaf6e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.354637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95828d22-8fc1-4325-abed-76c6aaf6e529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.355413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95828d22-8fc1-4325-abed-76c6aaf6e529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.357001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95828d22-8fc1-4325-abed-76c6aaf6e529 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.361254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9938-7470-4c54-8869-8b2166ef7ce5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.365968 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42baf9-53a8-4942-a904-119c3db8dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.366628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42baf9-53a8-4942-a904-119c3db8dee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.366908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42baf9-53a8-4942-a904-119c3db8dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.367215 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42baf9-53a8-4942-a904-119c3db8dee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.367353 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1123/2276] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:31.370235 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42baf9-53a8-4942-a904-119c3db8dee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.371399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95828d22-8fc1-4325-abed-76c6aaf6e529 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.372531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42baf9-53a8-4942-a904-119c3db8dee5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.380827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95828d22-8fc1-4325-abed-76c6aaf6e529 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.385949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0472e21-2c4e-4c45-b7c4-4c8bfda8ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.386988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0472e21-2c4e-4c45-b7c4-4c8bfda8ccbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.387330 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0472e21-2c4e-4c45-b7c4-4c8bfda8ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.387708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0472e21-2c4e-4c45-b7c4-4c8bfda8ccbc admin admin] PATH_INFO: `/v3/projects/1006aee6aba9424e936adc907f30fd41/users/07ec09d303ba4138b750628a35b6e594/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.397216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1154/2277] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:31 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:31.398334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42baf9-53a8-4942-a904-119c3db8dee5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.409697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0472e21-2c4e-4c45-b7c4-4c8bfda8ccbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1006aee6aba9424e936adc907f30fd41, user_id=07ec09d303ba4138b750628a35b6e594, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.410175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42baf9-53a8-4942-a904-119c3db8dee5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.412475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0472e21-2c4e-4c45-b7c4-4c8bfda8ccbc admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.416563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a58ea-d6eb-41e3-81dd-aa69590acb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.417280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a58ea-d6eb-41e3-81dd-aa69590acb9b admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.417562 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a58ea-d6eb-41e3-81dd-aa69590acb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.417834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a58ea-d6eb-41e3-81dd-aa69590acb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.418563 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a58ea-d6eb-41e3-81dd-aa69590acb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.420165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a58ea-d6eb-41e3-81dd-aa69590acb9b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.432080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1155/2278] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:31.435255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1124/2279] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:31 2022] PUT /identity/v3/projects/1006aee6aba9424e936adc907f30fd41/users/07ec09d303ba4138b750628a35b6e594/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:31.436104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a58ea-d6eb-41e3-81dd-aa69590acb9b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.439778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709bb05-ada3-4119-9b0f-7ca7aa4af04f None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.440072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709bb05-ada3-4119-9b0f-7ca7aa4af04f None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.440349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709bb05-ada3-4119-9b0f-7ca7aa4af04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.445728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a58ea-d6eb-41e3-81dd-aa69590acb9b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.457776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-7709bb05-ada3-4119-9b0f-7ca7aa4af04f None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:31.458907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7709bb05-ada3-4119-9b0f-7ca7aa4af04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:31.503245 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.503913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.504204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.504480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.505238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.506832 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.517033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1125/2281] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:31.517212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1156/2281] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:31.521123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709bb05-ada3-4119-9b0f-7ca7aa4af04f None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.529506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.530851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709bb05-ada3-4119-9b0f-7ca7aa4af04f None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.532150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:31.536456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c6d08-bb39-481d-8754-b2292cc64ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.537372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6d08-bb39-481d-8754-b2292cc64ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.537829 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6d08-bb39-481d-8754-b2292cc64ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.538152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6d08-bb39-481d-8754-b2292cc64ea0 admin admin] PATH_INFO: `/v3/projects/74b7a571b34b499893780a3882b0f1f3/users/5b774dec241044828a5b6a8caf231e19/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.554509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c6d08-bb39-481d-8754-b2292cc64ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b7a571b34b499893780a3882b0f1f3, user_id=5b774dec241044828a5b6a8caf231e19, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.557339 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c6d08-bb39-481d-8754-b2292cc64ea0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.570677 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1126/2282] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:31 2022] PUT /identity/v3/projects/74b7a571b34b499893780a3882b0f1f3/users/5b774dec241044828a5b6a8caf231e19/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:31.582826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cecba-c7cd-4469-8e1b-a86c3697ce5b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.583153 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cecba-c7cd-4469-8e1b-a86c3697ce5b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.583432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cecba-c7cd-4469-8e1b-a86c3697ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.591018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a86a-9d89-43be-a652-69cbebf52b2d admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.610666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-cf7cecba-c7cd-4469-8e1b-a86c3697ce5b None None] MFA Rules not processed for user `5b774dec241044828a5b6a8caf231e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:31.612060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-cf7cecba-c7cd-4469-8e1b-a86c3697ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:31.657482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.659067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.659067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.659067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.685633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1127/2283] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:31.690158 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5ba35-c6bf-4bbf-a215-9baba1890213 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.690158 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5ba35-c6bf-4bbf-a215-9baba1890213 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.690158 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5ba35-c6bf-4bbf-a215-9baba1890213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.705935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-42d5ba35-c6bf-4bbf-a215-9baba1890213 None None] MFA Rules not processed for user `8f85454e20524acdb9d2dd01d8a71c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:31.707177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-42d5ba35-c6bf-4bbf-a215-9baba1890213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:31.731664 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.733348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.744172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1157/2284] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:31.745205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.746709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:31.774976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1128/2285] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:31.832042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38672e-3280-426b-b411-5ec18a852247 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.836016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49005dd7-56c5-414c-b601-5393941fd4bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.836730 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005dd7-56c5-414c-b601-5393941fd4bb service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.837017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005dd7-56c5-414c-b601-5393941fd4bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.837296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005dd7-56c5-414c-b601-5393941fd4bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.855851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49005dd7-56c5-414c-b601-5393941fd4bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.857419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49005dd7-56c5-414c-b601-5393941fd4bb service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.868503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1158/2286] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:31.888522 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5ba35-c6bf-4bbf-a215-9baba1890213 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:31.899818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5ba35-c6bf-4bbf-a215-9baba1890213 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:31.904598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:31.905549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:31.905898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:31.906814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] PATH_INFO: `/v3/users/5b774dec241044828a5b6a8caf231e19` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:31.908104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b774dec241044828a5b6a8caf231e19)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:31.910076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:31.971836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b774dec241044828a5b6a8caf231e19'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:31.979054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b774dec241044828a5b6a8caf231e19'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:31.990008 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b774dec241044828a5b6a8caf231e19'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:31.990787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b774dec241044828a5b6a8caf231e19'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:32.003476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b774dec241044828a5b6a8caf231e19'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:32.009579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1129/2287] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:31 2022] DELETE /identity/v3/users/5b774dec241044828a5b6a8caf231e19 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:32.017251 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f587e-c345-4aa7-a0f8-61ff1a4b9a4a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:32.017921 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f587e-c345-4aa7-a0f8-61ff1a4b9a4a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:32.018411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f587e-c345-4aa7-a0f8-61ff1a4b9a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:32.052068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f20f587e-c345-4aa7-a0f8-61ff1a4b9a4a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:32.053297 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f20f587e-c345-4aa7-a0f8-61ff1a4b9a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:32.161839 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1159/2288] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:32.185019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:32.186476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:32.256745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edc99-f9fc-44bc-8813-eccb442553a9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:32.262008 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c738943-de5c-4be1-a068-8a010b22d590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:32.263342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738943-de5c-4be1-a068-8a010b22d590 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:32.263641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738943-de5c-4be1-a068-8a010b22d590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:32.264667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c738943-de5c-4be1-a068-8a010b22d590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:32.277163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c738943-de5c-4be1-a068-8a010b22d590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:32.279036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c738943-de5c-4be1-a068-8a010b22d590 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:32.291027 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1130/2289] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:32.613595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f587e-c345-4aa7-a0f8-61ff1a4b9a4a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:32.615298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f20f587e-c345-4aa7-a0f8-61ff1a4b9a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:32.632390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f587e-c345-4aa7-a0f8-61ff1a4b9a4a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:32.637278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:32.638220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:32.638583 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:32.638879 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] PATH_INFO: `/v3/projects/74b7a571b34b499893780a3882b0f1f3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:32.640283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b7a571b34b499893780a3882b0f1f3)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:32.643046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:32.705898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b7a571b34b499893780a3882b0f1f3', 'request_id': 'req-5ac0c705-55a4-4344-8f4c-448f7196c409'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:32.725462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b7a571b34b499893780a3882b0f1f3', 'request_id': 'req-5ac0c705-55a4-4344-8f4c-448f7196c409'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:32.739647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b7a571b34b499893780a3882b0f1f3', 'request_id': 'req-5ac0c705-55a4-4344-8f4c-448f7196c409'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:32.757008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] The token cache is being invalidate because project 74b7a571b34b499893780a3882b0f1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:32.757308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:32.758100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5ac0c705-55a4-4344-8f4c-448f7196c409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:32.759760 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1160/2290] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:32 2022] DELETE /identity/v3/projects/74b7a571b34b499893780a3882b0f1f3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:32.764787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea26d3-5709-44e2-a691-76d3fa6f9f09 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:32.765074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea26d3-5709-44e2-a691-76d3fa6f9f09 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:32.766011 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea26d3-5709-44e2-a691-76d3fa6f9f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:32.794212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-87ea26d3-5709-44e2-a691-76d3fa6f9f09 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:32.796092 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-87ea26d3-5709-44e2-a691-76d3fa6f9f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:32.855651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093cb46-da7e-4f55-96cb-60eab09ead95 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:32.856201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093cb46-da7e-4f55-96cb-60eab09ead95 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:32.856284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093cb46-da7e-4f55-96cb-60eab09ead95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:32.895372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4093cb46-da7e-4f55-96cb-60eab09ead95 None None] MFA Rules not processed for user `07ec09d303ba4138b750628a35b6e594`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:32.896652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4093cb46-da7e-4f55-96cb-60eab09ead95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:32.946933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1131/2291] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:32.956413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4c33d-fcf1-4aab-890c-aed6b3ac9612 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:32.956710 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4c33d-fcf1-4aab-890c-aed6b3ac9612 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:32.957047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4c33d-fcf1-4aab-890c-aed6b3ac9612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:32.981388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3aa4c33d-fcf1-4aab-890c-aed6b3ac9612 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:32.982916 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3aa4c33d-fcf1-4aab-890c-aed6b3ac9612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:32.997860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1132/2292] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:32.998872 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4c33d-fcf1-4aab-890c-aed6b3ac9612 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:32.999469 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1161/2293] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:33.008238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093cb46-da7e-4f55-96cb-60eab09ead95 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.010952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4093cb46-da7e-4f55-96cb-60eab09ead95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.018220 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4c33d-fcf1-4aab-890c-aed6b3ac9612 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.028361 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.029191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.029476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.029756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.030655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:33.031751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.031867 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093cb46-da7e-4f55-96cb-60eab09ead95 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.033668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.037164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2262c-1be2-4b31-a249-b7a49eff26e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.037829 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2262c-1be2-4b31-a249-b7a49eff26e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.038101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2262c-1be2-4b31-a249-b7a49eff26e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.038540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2262c-1be2-4b31-a249-b7a49eff26e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.039458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2262c-1be2-4b31-a249-b7a49eff26e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.041848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2262c-1be2-4b31-a249-b7a49eff26e7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.048108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1133/2294] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:33.054268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.076902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c179f0-a1fd-4878-b8ec-d502dfae49f8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.086062 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe27df-dbe9-4bda-810b-8980bec90ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.087435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe27df-dbe9-4bda-810b-8980bec90ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.087906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe27df-dbe9-4bda-810b-8980bec90ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.088793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe27df-dbe9-4bda-810b-8980bec90ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.089970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe27df-dbe9-4bda-810b-8980bec90ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.095661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe27df-dbe9-4bda-810b-8980bec90ce6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.106150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1162/2295] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:33 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:33.107931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2262c-1be2-4b31-a249-b7a49eff26e7 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.141733 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1134/2296] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:33 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:33.152104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe27df-dbe9-4bda-810b-8980bec90ce6 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.224556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2262c-1be2-4b31-a249-b7a49eff26e7 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.235000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe27df-dbe9-4bda-810b-8980bec90ce6 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.239801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.240749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.241265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.241970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.242593 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c1199-865b-4ce6-b154-9032a85fb65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.243331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.243676 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c1199-865b-4ce6-b154-9032a85fb65e admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.244100 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c1199-865b-4ce6-b154-9032a85fb65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.244479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c1199-865b-4ce6-b154-9032a85fb65e admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.245202 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c1199-865b-4ce6-b154-9032a85fb65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.246646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.247977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c1199-865b-4ce6-b154-9032a85fb65e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.272031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1163/2297] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:33 2022] POST /identity/v3/users => generated 308 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:33.274041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1135/2298] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:33 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:33.279239 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c1199-865b-4ce6-b154-9032a85fb65e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.280399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.295850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.309366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c1199-865b-4ce6-b154-9032a85fb65e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.315005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6050-502a-4dc4-924a-56606fbdf942 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.315730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e32d24-cbe0-44f8-be92-2517cd5d4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.316637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32d24-cbe0-44f8-be92-2517cd5d4313 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.317092 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32d24-cbe0-44f8-be92-2517cd5d4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.317372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32d24-cbe0-44f8-be92-2517cd5d4313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.318117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e32d24-cbe0-44f8-be92-2517cd5d4313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.319940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e32d24-cbe0-44f8-be92-2517cd5d4313 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.320682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.323182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.323182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.323182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] PATH_INFO: `/v3/users/4d0f40741bfe4f96b10776f0677208c4` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.323462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0f40741bfe4f96b10776f0677208c4)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.325537 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.333590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1136/2299] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:33.334261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e32d24-cbe0-44f8-be92-2517cd5d4313 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.348042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e32d24-cbe0-44f8-be92-2517cd5d4313 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.356190 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.357383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.357883 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.358222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.359600 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.361513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.373183 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1137/2300] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:33.374112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.376483 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.388969 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be22a-0d89-4366-9b4e-53fc8716eedd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.390406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0f40741bfe4f96b10776f0677208c4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.395104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.396029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.396288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.396637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] PATH_INFO: `/v3/users/fc7f7d77508b480ca301633a096f8e32` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.397983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7f7d77508b480ca301633a096f8e32)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.398192 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0f40741bfe4f96b10776f0677208c4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.400025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.406129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0f40741bfe4f96b10776f0677208c4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.406748 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0f40741bfe4f96b10776f0677208c4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.422488 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0f40741bfe4f96b10776f0677208c4'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.429719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1164/2301] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:33 2022] DELETE /identity/v3/users/4d0f40741bfe4f96b10776f0677208c4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:33.430524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.432102 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.452347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7f7d77508b480ca301633a096f8e32'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.459745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7f7d77508b480ca301633a096f8e32'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.468707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7f7d77508b480ca301633a096f8e32'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.469559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7f7d77508b480ca301633a096f8e32'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.488891 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7f7d77508b480ca301633a096f8e32'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:33.502631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1138/2302] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:33 2022] DELETE /identity/v3/users/fc7f7d77508b480ca301633a096f8e32 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:33.506478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.507953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.508092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7df87-4f48-4bd0-99bf-fcbbca9f94c9 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.572442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793f2b3-3a80-4418-90df-9208b863ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.573651 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793f2b3-3a80-4418-90df-9208b863ed18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.573933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793f2b3-3a80-4418-90df-9208b863ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.574253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793f2b3-3a80-4418-90df-9208b863ed18 admin admin] PATH_INFO: `/v3/projects/335700b63cfd4da5afa3cf8b0e07348e/users/b05f93b889fd4dada6359f79430ee587/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.582419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb379-d530-4de3-bbc0-8e559ef62b9f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.588304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3f6b6-ab32-49ce-9a50-24b269d5889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.588989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3f6b6-ab32-49ce-9a50-24b269d5889f admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.589280 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3f6b6-ab32-49ce-9a50-24b269d5889f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.589568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3f6b6-ab32-49ce-9a50-24b269d5889f admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.590306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3f6b6-ab32-49ce-9a50-24b269d5889f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.591945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3f6b6-ab32-49ce-9a50-24b269d5889f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.595485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793f2b3-3a80-4418-90df-9208b863ed18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335700b63cfd4da5afa3cf8b0e07348e, user_id=b05f93b889fd4dada6359f79430ee587, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.598185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793f2b3-3a80-4418-90df-9208b863ed18 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.603848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1139/2303] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:33.605911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9252363-0145-47ce-b4c0-f2b5126f2cb2 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.606433 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9252363-0145-47ce-b4c0-f2b5126f2cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.606937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9252363-0145-47ce-b4c0-f2b5126f2cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.618679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1165/2304] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:33 2022] PUT /identity/v3/projects/335700b63cfd4da5afa3cf8b0e07348e/users/b05f93b889fd4dada6359f79430ee587/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:33.621240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac19b98-9ec3-4acb-9df8-1821ecc2a953 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.621240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac19b98-9ec3-4acb-9df8-1821ecc2a953 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.621240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac19b98-9ec3-4acb-9df8-1821ecc2a953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.627980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-f9252363-0145-47ce-b4c0-f2b5126f2cb2 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:33.629226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f9252363-0145-47ce-b4c0-f2b5126f2cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.641214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-aac19b98-9ec3-4acb-9df8-1821ecc2a953 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:33.642404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-aac19b98-9ec3-4acb-9df8-1821ecc2a953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.693476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1140/2305] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:33.695895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9252363-0145-47ce-b4c0-f2b5126f2cb2 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.703458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1166/2306] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:33.703458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac19b98-9ec3-4acb-9df8-1821ecc2a953 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.703700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-aac19b98-9ec3-4acb-9df8-1821ecc2a953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.706325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9252363-0145-47ce-b4c0-f2b5126f2cb2 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.711378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.712261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.712548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.712820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] PATH_INFO: `/v3/projects/c63579da2c2e4f83811bf1fa9e1d2048/users/0912d9835fe446248fa9a47a439f7ea6/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.716051 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac19b98-9ec3-4acb-9df8-1821ecc2a953 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.721598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.722282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.722567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.722847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.723623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.725226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.734924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63579da2c2e4f83811bf1fa9e1d2048, user_id=0912d9835fe446248fa9a47a439f7ea6, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.736036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1167/2307] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:33.736819 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.737785 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.738456 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.751038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1141/2308] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:33 2022] PUT /identity/v3/projects/c63579da2c2e4f83811bf1fa9e1d2048/users/0912d9835fe446248fa9a47a439f7ea6/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:33.752397 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.754254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:33.797708 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09307b75-2dee-4a41-9270-dc9e7b3c310a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.812863 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b9448-136b-40f3-a890-4d63e476b699 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.817524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfce1ca-5990-49c5-8caa-e5ffd9f88d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.818177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce1ca-5990-49c5-8caa-e5ffd9f88d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.818463 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce1ca-5990-49c5-8caa-e5ffd9f88d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.818992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce1ca-5990-49c5-8caa-e5ffd9f88d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.852875 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e990f4-9baa-434e-8eeb-33411e7a48a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.853525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e990f4-9baa-434e-8eeb-33411e7a48a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.853891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e990f4-9baa-434e-8eeb-33411e7a48a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.854072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e990f4-9baa-434e-8eeb-33411e7a48a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.891047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfce1ca-5990-49c5-8caa-e5ffd9f88d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.892814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfce1ca-5990-49c5-8caa-e5ffd9f88d48 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.903824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1142/2309] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:33.905231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfce1ca-5990-49c5-8caa-e5ffd9f88d48 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:33.916213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfce1ca-5990-49c5-8caa-e5ffd9f88d48 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:33.920185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e990f4-9baa-434e-8eeb-33411e7a48a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.922670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e990f4-9baa-434e-8eeb-33411e7a48a9 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.923072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:33.924030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.924385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.924729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] PATH_INFO: `/v3/projects/335700b63cfd4da5afa3cf8b0e07348e/users/b05f93b889fd4dada6359f79430ee587/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.927231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335700b63cfd4da5afa3cf8b0e07348e, user_id=b05f93b889fd4dada6359f79430ee587, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:33.930832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:33.934362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1168/2310] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:33.935697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ce9f-8794-44bb-89a0-c048f6f9aa06 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:33.936097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ce9f-8794-44bb-89a0-c048f6f9aa06 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:33.936253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ce9f-8794-44bb-89a0-c048f6f9aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:33.944288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1143/2311] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:33 2022] PUT /identity/v3/projects/335700b63cfd4da5afa3cf8b0e07348e/users/b05f93b889fd4dada6359f79430ee587/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:33.992449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-bee9ce9f-8794-44bb-89a0-c048f6f9aa06 None None] MFA Rules not processed for user `0912d9835fe446248fa9a47a439f7ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:33.993726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bee9ce9f-8794-44bb-89a0-c048f6f9aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:34.139399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1169/2312] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:34.156045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:34.157605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:34.258063 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8b8bd-a8ea-4d94-bbdd-9ae5d0b6ce23 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:34.262341 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:34.262812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:34.263355 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:34.263708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:34.293726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:34.295918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:34.308909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1144/2313] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:34.551063 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9ce9f-8794-44bb-89a0-c048f6f9aa06 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:34.552258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bee9ce9f-8794-44bb-89a0-c048f6f9aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:34.666828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:34.668888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:34.687747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9ce9f-8794-44bb-89a0-c048f6f9aa06 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:34.692460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886d17-4ded-4290-9c2c-d1e7b4ec0e16 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:34.693793 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:34.695103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:34.695593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:34.696073 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] PATH_INFO: `/v3/projects/5221a00ef39c428cbaa0d82d6880d65a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:34.697808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5221a00ef39c428cbaa0d82d6880d65a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:34.700204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:34.702536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:34.724193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:34.724193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:34.724193 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] PATH_INFO: `/v3/projects/690278292b0c4cc88b63050185f2882e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:34.726053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690278292b0c4cc88b63050185f2882e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:34.733004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:34.806462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5221a00ef39c428cbaa0d82d6880d65a', 'request_id': 'req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.837878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5221a00ef39c428cbaa0d82d6880d65a', 'request_id': 'req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.850795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5221a00ef39c428cbaa0d82d6880d65a', 'request_id': 'req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.852603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690278292b0c4cc88b63050185f2882e', 'request_id': 'req-f8d97535-3721-4a56-897b-7071a37f98a8'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.863406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690278292b0c4cc88b63050185f2882e', 'request_id': 'req-f8d97535-3721-4a56-897b-7071a37f98a8'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.867050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] The token cache is being invalidate because project 5221a00ef39c428cbaa0d82d6880d65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:34.867348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.868056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a9ae307c-392c-4ebb-8b2c-9c655ceb4832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.870238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1170/2314] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:34 2022] DELETE /identity/v3/projects/5221a00ef39c428cbaa0d82d6880d65a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:34.876376 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54b33-d4fe-469b-b101-fa23e82b4dc9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:34.876847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54b33-d4fe-469b-b101-fa23e82b4dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:34.877263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54b33-d4fe-469b-b101-fa23e82b4dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:34.885389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690278292b0c4cc88b63050185f2882e', 'request_id': 'req-f8d97535-3721-4a56-897b-7071a37f98a8'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.913642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3ef54b33-d4fe-469b-b101-fa23e82b4dc9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:34.915224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] The token cache is being invalidate because project 690278292b0c4cc88b63050185f2882e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:34.915706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.916792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f8d97535-3721-4a56-897b-7071a37f98a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:34.917442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3ef54b33-d4fe-469b-b101-fa23e82b4dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:34.918869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1145/2315] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:34 2022] DELETE /identity/v3/projects/690278292b0c4cc88b63050185f2882e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:34.924213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acea36-86d2-419b-96cb-2cc4e1558a63 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:34.924663 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acea36-86d2-419b-96cb-2cc4e1558a63 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:34.925036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acea36-86d2-419b-96cb-2cc4e1558a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:34.954769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-62acea36-86d2-419b-96cb-2cc4e1558a63 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:34.956354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-62acea36-86d2-419b-96cb-2cc4e1558a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:35.041389 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1171/2316] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:35.049372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bab45f-6e14-462a-bdd0-9ce20cb53ab0 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.049668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bab45f-6e14-462a-bdd0-9ce20cb53ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.049951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bab45f-6e14-462a-bdd0-9ce20cb53ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.066165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1146/2317] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:35.072618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-57bab45f-6e14-462a-bdd0-9ce20cb53ab0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:35.074605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26533e-0d31-40eb-a0b4-4e264044687d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.075012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26533e-0d31-40eb-a0b4-4e264044687d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.075393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26533e-0d31-40eb-a0b4-4e264044687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.076772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-57bab45f-6e14-462a-bdd0-9ce20cb53ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:35.095065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1172/2318] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:35.096241 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bab45f-6e14-462a-bdd0-9ce20cb53ab0 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.099960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ca26533e-0d31-40eb-a0b4-4e264044687d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:35.101310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ca26533e-0d31-40eb-a0b4-4e264044687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:35.107992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bab45f-6e14-462a-bdd0-9ce20cb53ab0 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.113018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1147/2319] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:35.114496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26533e-0d31-40eb-a0b4-4e264044687d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.117195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.118474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.118933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.119404 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.120654 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:35.121464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.123870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.125245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26533e-0d31-40eb-a0b4-4e264044687d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.131141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.132002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.132388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.132852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.133750 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:35.134178 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.136155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.139361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1173/2320] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:35.144473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.153876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1148/2321] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:35.155674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.170989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e004e0-5e86-4397-a7b3-c2321ef671d2 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.179009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed6f4-2163-4a6f-8b49-a80b7655c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.179842 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed6f4-2163-4a6f-8b49-a80b7655c301 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.180676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed6f4-2163-4a6f-8b49-a80b7655c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.180676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed6f4-2163-4a6f-8b49-a80b7655c301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.181176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52ca75-a4e8-4dc2-a03b-bcd23134f531 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.182301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaed6f4-2163-4a6f-8b49-a80b7655c301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.184352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaed6f4-2163-4a6f-8b49-a80b7655c301 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.188224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5abe-3505-4cd4-860a-01745ab91825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.189152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5abe-3505-4cd4-860a-01745ab91825 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.189706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5abe-3505-4cd4-860a-01745ab91825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.190152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5abe-3505-4cd4-860a-01745ab91825 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.190846 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b5abe-3505-4cd4-860a-01745ab91825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.193550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b5abe-3505-4cd4-860a-01745ab91825 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.225273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1174/2322] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:35.229318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed6f4-2163-4a6f-8b49-a80b7655c301 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.235911 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1149/2323] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:35.239935 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5abe-3505-4cd4-860a-01745ab91825 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.344559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5abe-3505-4cd4-860a-01745ab91825 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.353230 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23428b9-ad97-47ed-af7e-e27c63c78938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.354932 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23428b9-ad97-47ed-af7e-e27c63c78938 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.355268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23428b9-ad97-47ed-af7e-e27c63c78938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.355549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23428b9-ad97-47ed-af7e-e27c63c78938 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.356706 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23428b9-ad97-47ed-af7e-e27c63c78938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.359018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23428b9-ad97-47ed-af7e-e27c63c78938 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.359209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed6f4-2163-4a6f-8b49-a80b7655c301 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.367797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bfbf-bde4-48b9-8ac4-34cb23da007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.368775 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bfbf-bde4-48b9-8ac4-34cb23da007e admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.369213 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bfbf-bde4-48b9-8ac4-34cb23da007e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.370094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4bfbf-bde4-48b9-8ac4-34cb23da007e admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.370994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bfbf-bde4-48b9-8ac4-34cb23da007e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.373299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4bfbf-bde4-48b9-8ac4-34cb23da007e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.412600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1175/2324] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:35.422472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bfbf-bde4-48b9-8ac4-34cb23da007e admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.423571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1150/2325] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:35.425177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23428b9-ad97-47ed-af7e-e27c63c78938 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.435472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4bfbf-bde4-48b9-8ac4-34cb23da007e admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.439937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23428b9-ad97-47ed-af7e-e27c63c78938 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.442705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27093aa9-4e8e-4eda-b381-8991d623ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.443780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27093aa9-4e8e-4eda-b381-8991d623ba81 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.444366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27093aa9-4e8e-4eda-b381-8991d623ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.444794 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27093aa9-4e8e-4eda-b381-8991d623ba81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.445623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a439b3-8762-4d8f-aa83-fe7a8eb1fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.446168 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27093aa9-4e8e-4eda-b381-8991d623ba81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.446729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a439b3-8762-4d8f-aa83-fe7a8eb1fa73 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.447508 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a439b3-8762-4d8f-aa83-fe7a8eb1fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.448133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a439b3-8762-4d8f-aa83-fe7a8eb1fa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.448911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27093aa9-4e8e-4eda-b381-8991d623ba81 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.449815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a439b3-8762-4d8f-aa83-fe7a8eb1fa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.454152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a439b3-8762-4d8f-aa83-fe7a8eb1fa73 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.470118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1151/2326] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:35.475011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1176/2327] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:35.475164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a439b3-8762-4d8f-aa83-fe7a8eb1fa73 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.477980 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27093aa9-4e8e-4eda-b381-8991d623ba81 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.507750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27093aa9-4e8e-4eda-b381-8991d623ba81 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.508780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a439b3-8762-4d8f-aa83-fe7a8eb1fa73 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.521507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e372447-a253-40a5-a013-e44ece7cc8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.522178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372447-a253-40a5-a013-e44ece7cc8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.522461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372447-a253-40a5-a013-e44ece7cc8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.522738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372447-a253-40a5-a013-e44ece7cc8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.523494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e372447-a253-40a5-a013-e44ece7cc8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.526486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50b3c9-2905-4120-813c-ec6f6201ceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.527370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50b3c9-2905-4120-813c-ec6f6201ceff admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.527980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50b3c9-2905-4120-813c-ec6f6201ceff admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.527980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50b3c9-2905-4120-813c-ec6f6201ceff admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.528643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50b3c9-2905-4120-813c-ec6f6201ceff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.530610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50b3c9-2905-4120-813c-ec6f6201ceff admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.531234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e372447-a253-40a5-a013-e44ece7cc8ae admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.552640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1177/2328] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:35.553897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1e19-7b0d-4d27-994d-1eea8f0f5c4a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.554184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1e19-7b0d-4d27-994d-1eea8f0f5c4a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.557978 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1e19-7b0d-4d27-994d-1eea8f0f5c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.558093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1152/2329] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:35.558093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50b3c9-2905-4120-813c-ec6f6201ceff admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.570568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50b3c9-2905-4120-813c-ec6f6201ceff admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.576547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d84b-34fe-446f-88c8-6d0f4be028d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.577507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d84b-34fe-446f-88c8-6d0f4be028d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.577939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d84b-34fe-446f-88c8-6d0f4be028d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.578333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1d84b-34fe-446f-88c8-6d0f4be028d1 admin admin] PATH_INFO: `/v3/projects/84465c37c1474aa68266191586ba2953/users/1bc2420288964c389f6529d9ede09bd4/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.585644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1b7f1e19-7b0d-4d27-994d-1eea8f0f5c4a None None] MFA Rules not processed for user `b05f93b889fd4dada6359f79430ee587`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:35.591771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1b7f1e19-7b0d-4d27-994d-1eea8f0f5c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:35.598386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1d84b-34fe-446f-88c8-6d0f4be028d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84465c37c1474aa68266191586ba2953, user_id=1bc2420288964c389f6529d9ede09bd4, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.603115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1d84b-34fe-446f-88c8-6d0f4be028d1 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.622752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1153/2330] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:35 2022] PUT /identity/v3/projects/84465c37c1474aa68266191586ba2953/users/1bc2420288964c389f6529d9ede09bd4/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:35.622752 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d84b-34fe-446f-88c8-6d0f4be028d1 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.727675 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1d84b-34fe-446f-88c8-6d0f4be028d1 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.739036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1178/2331] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:35.744569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.745673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.746029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.746882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b6ff5-0865-4d4c-9225-79a6e1b1aa04 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.747210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b6ff5-0865-4d4c-9225-79a6e1b1aa04 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.747495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b6ff5-0865-4d4c-9225-79a6e1b1aa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.754071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] PATH_INFO: `/v3/projects/a5da35de420b4b908dde94da66c0ecd2/users/97dcd026697f4ac099a2f518408b89ed/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.769291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b99b6ff5-0865-4d4c-9225-79a6e1b1aa04 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:35.771071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b99b6ff5-0865-4d4c-9225-79a6e1b1aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:35.781240 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1179/2332] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:35.789661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5da35de420b4b908dde94da66c0ecd2, user_id=97dcd026697f4ac099a2f518408b89ed, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:35.792843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:35.812965 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1154/2333] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:35 2022] PUT /identity/v3/projects/a5da35de420b4b908dde94da66c0ecd2/users/97dcd026697f4ac099a2f518408b89ed/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:35.817988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e42b0-4702-44c8-b7db-f813800ed566 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.817988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e42b0-4702-44c8-b7db-f813800ed566 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.818303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e42b0-4702-44c8-b7db-f813800ed566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.825946 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.829818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:35.839318 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-473e42b0-4702-44c8-b7db-f813800ed566 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:35.841595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-473e42b0-4702-44c8-b7db-f813800ed566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:35.961790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1180/2334] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:35.964443 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b55920-b876-4b42-8927-9210a86ce63e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:35.969639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:35.970640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:35.970927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:35.971281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:35.974446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e42b0-4702-44c8-b7db-f813800ed566 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:35.976160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-473e42b0-4702-44c8-b7db-f813800ed566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:35.997275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e42b0-4702-44c8-b7db-f813800ed566 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:36.002155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:36.003742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:36.010146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e7ee0-7abf-478f-b9cb-731bb801a15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:36.010808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e7ee0-7abf-478f-b9cb-731bb801a15f service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:36.011119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e7ee0-7abf-478f-b9cb-731bb801a15f service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:36.011403 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e7ee0-7abf-478f-b9cb-731bb801a15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:36.026199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1155/2335] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:36.026443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e7ee0-7abf-478f-b9cb-731bb801a15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:36.028386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e7ee0-7abf-478f-b9cb-731bb801a15f service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:36.052722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1181/2336] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:37.619371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:37.620926 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:37.639840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35cc81-64bf-48f3-a51d-66afbe0970ee service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:37.651091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:37.652083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:37.652449 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:37.652802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] PATH_INFO: `/v3/users/07ec09d303ba4138b750628a35b6e594` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:37.654076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ec09d303ba4138b750628a35b6e594)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:37.656729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:37.728577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ec09d303ba4138b750628a35b6e594'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:37.738300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ec09d303ba4138b750628a35b6e594'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:37.749446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ec09d303ba4138b750628a35b6e594'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:37.750326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ec09d303ba4138b750628a35b6e594'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:37.792282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ec09d303ba4138b750628a35b6e594'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:37.801085 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1156/2337] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:37 2022] DELETE /identity/v3/users/07ec09d303ba4138b750628a35b6e594 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:38.247885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e7ee0-7abf-478f-b9cb-731bb801a15f service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:38.263142 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e7ee0-7abf-478f-b9cb-731bb801a15f service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:38.352204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:38.354083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:38.354561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:38.355052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] PATH_INFO: `/v3/projects/1006aee6aba9424e936adc907f30fd41` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:38.356509 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1006aee6aba9424e936adc907f30fd41)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:38.358663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:38.421101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1006aee6aba9424e936adc907f30fd41', 'request_id': 'req-5949ad98-bad2-40c9-803c-db2cf712552e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.439169 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1006aee6aba9424e936adc907f30fd41', 'request_id': 'req-5949ad98-bad2-40c9-803c-db2cf712552e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.448558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1006aee6aba9424e936adc907f30fd41', 'request_id': 'req-5949ad98-bad2-40c9-803c-db2cf712552e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.464860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] The token cache is being invalidate because project 1006aee6aba9424e936adc907f30fd41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:38.465152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.465826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.467511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1182/2338] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:38 2022] DELETE /identity/v3/projects/1006aee6aba9424e936adc907f30fd41 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:38.471653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:38.473174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:38.488028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9265244-8dc7-4ec0-94e1-be4bebe4450f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:38.585682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:38.589462 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:38.590031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:38.590585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] PATH_INFO: `/v3/users/b05f93b889fd4dada6359f79430ee587` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:38.592478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05f93b889fd4dada6359f79430ee587)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:38.595934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:38.677451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05f93b889fd4dada6359f79430ee587'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.688970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05f93b889fd4dada6359f79430ee587'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.705114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05f93b889fd4dada6359f79430ee587'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.707000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05f93b889fd4dada6359f79430ee587'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.725962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-face1824-35d1-4d1f-9eb9-c13396936fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05f93b889fd4dada6359f79430ee587'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:38.738557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1157/2339] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:38 2022] DELETE /identity/v3/users/b05f93b889fd4dada6359f79430ee587 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:39.243184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:39.246566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:39.289305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ad98-bad2-40c9-803c-db2cf712552e admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:39.517878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:39.519018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:39.519327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:39.520062 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] PATH_INFO: `/v3/projects/335700b63cfd4da5afa3cf8b0e07348e` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:39.521644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335700b63cfd4da5afa3cf8b0e07348e)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:39.523736 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:39.584179 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335700b63cfd4da5afa3cf8b0e07348e', 'request_id': 'req-d6cbd21c-1f13-47e1-bd91-357e68077103'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:39.592644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335700b63cfd4da5afa3cf8b0e07348e', 'request_id': 'req-d6cbd21c-1f13-47e1-bd91-357e68077103'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:39.603790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335700b63cfd4da5afa3cf8b0e07348e', 'request_id': 'req-d6cbd21c-1f13-47e1-bd91-357e68077103'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:39.618601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] The token cache is being invalidate because project 335700b63cfd4da5afa3cf8b0e07348e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:39.619272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:39.620239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-d6cbd21c-1f13-47e1-bd91-357e68077103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:39.622277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1183/2340] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:39 2022] DELETE /identity/v3/projects/335700b63cfd4da5afa3cf8b0e07348e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:39.627318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f36d-772e-4651-b8d7-54ea6261a68d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:39.627876 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f36d-772e-4651-b8d7-54ea6261a68d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:39.628268 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f36d-772e-4651-b8d7-54ea6261a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:39.654658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1af7f36d-772e-4651-b8d7-54ea6261a68d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:39.657246 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1af7f36d-772e-4651-b8d7-54ea6261a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:39.769324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1158/2341] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:39.777218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b0ba-fa05-40aa-97e7-bce81942724b None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:39.777524 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b0ba-fa05-40aa-97e7-bce81942724b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:39.777779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b0ba-fa05-40aa-97e7-bce81942724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:39.799116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-6657b0ba-fa05-40aa-97e7-bce81942724b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:39.800385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6657b0ba-fa05-40aa-97e7-bce81942724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:39.808995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1184/2342] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:39.813898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7f36d-772e-4651-b8d7-54ea6261a68d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:39.832206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7f36d-772e-4651-b8d7-54ea6261a68d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:39.837728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:39.838572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:39.838998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:39.839498 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:39.840357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:39.840771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:39.842569 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:39.861103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1159/2343] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:46:39.862701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657b0ba-fa05-40aa-97e7-bce81942724b None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:39.874721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657b0ba-fa05-40aa-97e7-bce81942724b None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:39.880410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad25c0-8afb-4ff6-a805-f15262af50ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:39.881083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad25c0-8afb-4ff6-a805-f15262af50ea admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:39.881363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad25c0-8afb-4ff6-a805-f15262af50ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:39.881653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad25c0-8afb-4ff6-a805-f15262af50ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:39.882681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad25c0-8afb-4ff6-a805-f15262af50ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:39.884724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad25c0-8afb-4ff6-a805-f15262af50ea admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:39.926549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1185/2344] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:39 2022] POST /identity/v3/projects => generated 355 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:39.927340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:39.939936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9144-5eba-4d85-b665-e36925f01429 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:40.026844 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff7273-92b4-49ea-beea-8de35d2aa696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:40.027838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff7273-92b4-49ea-beea-8de35d2aa696 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:40.028672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff7273-92b4-49ea-beea-8de35d2aa696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:40.028672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff7273-92b4-49ea-beea-8de35d2aa696 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:40.029191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff7273-92b4-49ea-beea-8de35d2aa696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:40.031964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff7273-92b4-49ea-beea-8de35d2aa696 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:40.060015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1160/2345] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:39 2022] POST /identity/v3/users => generated 278 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:40.063957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad25c0-8afb-4ff6-a805-f15262af50ea admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:40.075447 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad25c0-8afb-4ff6-a805-f15262af50ea admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:40.109915 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff494c-64a3-4bca-a11a-fd9dc9e2916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:40.110763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff494c-64a3-4bca-a11a-fd9dc9e2916c admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:40.111727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff494c-64a3-4bca-a11a-fd9dc9e2916c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:40.112108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff494c-64a3-4bca-a11a-fd9dc9e2916c admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:40.112973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff494c-64a3-4bca-a11a-fd9dc9e2916c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:40.117322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff494c-64a3-4bca-a11a-fd9dc9e2916c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:40.140956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1186/2346] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:40.145238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff7273-92b4-49ea-beea-8de35d2aa696 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:40.159224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff7273-92b4-49ea-beea-8de35d2aa696 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:40.165909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec90e69-e1bd-4cc2-877c-f4cecfb7700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:40.166934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90e69-e1bd-4cc2-877c-f4cecfb7700e admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:40.169043 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90e69-e1bd-4cc2-877c-f4cecfb7700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:40.169905 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90e69-e1bd-4cc2-877c-f4cecfb7700e admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:40.170880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec90e69-e1bd-4cc2-877c-f4cecfb7700e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:40.174429 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec90e69-e1bd-4cc2-877c-f4cecfb7700e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:40.186290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1161/2347] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:40.190350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff494c-64a3-4bca-a11a-fd9dc9e2916c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:40.204417 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff494c-64a3-4bca-a11a-fd9dc9e2916c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:40.218041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f63ba-b008-436c-ae0b-463c519bdd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:40.219932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f63ba-b008-436c-ae0b-463c519bdd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:40.220120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f63ba-b008-436c-ae0b-463c519bdd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:40.220397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f63ba-b008-436c-ae0b-463c519bdd0a admin admin] PATH_INFO: `/v3/projects/5cc182d957a24831801e62ab23f76cc1/users/a17a147fe22f4668a4879df662e6cf10/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:40.260923 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f63ba-b008-436c-ae0b-463c519bdd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc182d957a24831801e62ab23f76cc1, user_id=a17a147fe22f4668a4879df662e6cf10, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:40.263764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f63ba-b008-436c-ae0b-463c519bdd0a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:40.294231 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1187/2348] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:40 2022] PUT /identity/v3/projects/5cc182d957a24831801e62ab23f76cc1/users/a17a147fe22f4668a4879df662e6cf10/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:40.309159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc70d-9e1b-4269-bbb1-ad02c7f3ea9b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:40.309587 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc70d-9e1b-4269-bbb1-ad02c7f3ea9b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:40.310000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc70d-9e1b-4269-bbb1-ad02c7f3ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:40.387725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-2ebdc70d-9e1b-4269-bbb1-ad02c7f3ea9b None None] MFA Rules not processed for user `a17a147fe22f4668a4879df662e6cf10`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:40.389712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-2ebdc70d-9e1b-4269-bbb1-ad02c7f3ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:40.630367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1162/2349] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:40 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:40.632000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f63ba-b008-436c-ae0b-463c519bdd0a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:40.777695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f63ba-b008-436c-ae0b-463c519bdd0a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:40.799508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e032-5e7b-46b3-a02c-91d36fea4b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:40.800173 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e032-5e7b-46b3-a02c-91d36fea4b1b admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:40.800702 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e032-5e7b-46b3-a02c-91d36fea4b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:40.800986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e032-5e7b-46b3-a02c-91d36fea4b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:40.801691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e032-5e7b-46b3-a02c-91d36fea4b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:40.803644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e032-5e7b-46b3-a02c-91d36fea4b1b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:40.864170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1188/2350] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:40 2022] POST /identity/v3/projects => generated 357 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:40.868446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc70d-9e1b-4269-bbb1-ad02c7f3ea9b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:40.898767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc70d-9e1b-4269-bbb1-ad02c7f3ea9b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:41.001010 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a11e1a-6ccf-4999-8a40-1eb2ae537de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:41.005563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a11e1a-6ccf-4999-8a40-1eb2ae537de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:41.005766 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a11e1a-6ccf-4999-8a40-1eb2ae537de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:41.006048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a11e1a-6ccf-4999-8a40-1eb2ae537de0 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:41.006796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a11e1a-6ccf-4999-8a40-1eb2ae537de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:41.009763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a11e1a-6ccf-4999-8a40-1eb2ae537de0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:41.060985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1163/2351] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:40 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:41.066719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e032-5e7b-46b3-a02c-91d36fea4b1b admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:41.082759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e032-5e7b-46b3-a02c-91d36fea4b1b admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:41.090461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc804-ef8a-43f3-92e1-c39694b1ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:41.093112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc804-ef8a-43f3-92e1-c39694b1ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:41.094697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc804-ef8a-43f3-92e1-c39694b1ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:41.095259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc804-ef8a-43f3-92e1-c39694b1ac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:41.096578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc804-ef8a-43f3-92e1-c39694b1ac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:41.098886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc804-ef8a-43f3-92e1-c39694b1ac08 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:41.138553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a11e1a-6ccf-4999-8a40-1eb2ae537de0 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:41.148949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a11e1a-6ccf-4999-8a40-1eb2ae537de0 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:41.151163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1189/2352] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:41.163956 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94b92-2819-41a5-8cda-b71e3abe8fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:41.166868 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94b92-2819-41a5-8cda-b71e3abe8fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:41.167315 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94b92-2819-41a5-8cda-b71e3abe8fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:41.168762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94b92-2819-41a5-8cda-b71e3abe8fe9 admin admin] PATH_INFO: `/v3/projects/2ac6430ab25f4aaf8e9c3fc14da1f9b7/users/5bba12f26995416da049ac4fbe927f8a/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:41.211709 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94b92-2819-41a5-8cda-b71e3abe8fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac6430ab25f4aaf8e9c3fc14da1f9b7, user_id=5bba12f26995416da049ac4fbe927f8a, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:41.214572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94b92-2819-41a5-8cda-b71e3abe8fe9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:41.247921 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1164/2353] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:41 2022] PUT /identity/v3/projects/2ac6430ab25f4aaf8e9c3fc14da1f9b7/users/5bba12f26995416da049ac4fbe927f8a/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:46:41.248935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc804-ef8a-43f3-92e1-c39694b1ac08 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:41.264756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc804-ef8a-43f3-92e1-c39694b1ac08 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:41.427497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f771d4-51ef-4f04-8316-f3f8a0910f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:41.428321 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f771d4-51ef-4f04-8316-f3f8a0910f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:41.428726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f771d4-51ef-4f04-8316-f3f8a0910f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:41.429107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f771d4-51ef-4f04-8316-f3f8a0910f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:41.430119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f771d4-51ef-4f04-8316-f3f8a0910f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:41.431887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f771d4-51ef-4f04-8316-f3f8a0910f11 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:41.465084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1190/2354] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:41.470421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94b92-2819-41a5-8cda-b71e3abe8fe9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:41.498097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94b92-2819-41a5-8cda-b71e3abe8fe9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:41.515960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:41.517039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:41.517979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:41.518466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] PATH_INFO: `/v3/projects/2ac6430ab25f4aaf8e9c3fc14da1f9b7/users/5bba12f26995416da049ac4fbe927f8a/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:41.525585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac6430ab25f4aaf8e9c3fc14da1f9b7, user_id=5bba12f26995416da049ac4fbe927f8a, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:41.529239 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:41.559993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1165/2355] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:41 2022] PUT /identity/v3/projects/2ac6430ab25f4aaf8e9c3fc14da1f9b7/users/5bba12f26995416da049ac4fbe927f8a/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:41.570499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65394561-18a1-45b8-8ba1-6f7c886c53ab None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:41.571356 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65394561-18a1-45b8-8ba1-6f7c886c53ab None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:41.571872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65394561-18a1-45b8-8ba1-6f7c886c53ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:41.643206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-65394561-18a1-45b8-8ba1-6f7c886c53ab None None] MFA Rules not processed for user `5bba12f26995416da049ac4fbe927f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:41.644835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-65394561-18a1-45b8-8ba1-6f7c886c53ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:41.844907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1191/2356] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:41 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:41.845493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:41.847487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:41.984206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35809a3-db0d-480a-b4ad-b3c78624c91a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:41.994329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:41.998097 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:41.998395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:41.999003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:42.023585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:42.027725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:42.051132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1166/2357] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:41 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:46:42.152587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65394561-18a1-45b8-8ba1-6f7c886c53ab None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:42.163982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65394561-18a1-45b8-8ba1-6f7c886c53ab None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:42.168634 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a6aec-26c6-4823-8974-68fbc963ebc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:42.169588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6aec-26c6-4823-8974-68fbc963ebc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:42.170025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6aec-26c6-4823-8974-68fbc963ebc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:42.170453 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6aec-26c6-4823-8974-68fbc963ebc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:42.281758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a6aec-26c6-4823-8974-68fbc963ebc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:42.283302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a6aec-26c6-4823-8974-68fbc963ebc0 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:42.314442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1192/2358] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:42 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:44.438333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:44.439866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:44.506010 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314adbd9-c2b3-408b-a04d-7c2ead6b9cfe None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:44.506952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314adbd9-c2b3-408b-a04d-7c2ead6b9cfe None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:44.507765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314adbd9-c2b3-408b-a04d-7c2ead6b9cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:44.590559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-314adbd9-c2b3-408b-a04d-7c2ead6b9cfe None None] MFA Rules not processed for user `1bc2420288964c389f6529d9ede09bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:44.592068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-314adbd9-c2b3-408b-a04d-7c2ead6b9cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:44.621156 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ae564-d5bc-490f-8980-be0f20757bc2 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:44.635188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:44.636428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:44.637075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:44.637499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] PATH_INFO: `/v3/users/0912d9835fe446248fa9a47a439f7ea6` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:44.638951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0912d9835fe446248fa9a47a439f7ea6)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:44.641396 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:44.710874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1193/2359] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:44.712709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314adbd9-c2b3-408b-a04d-7c2ead6b9cfe None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:44.714455 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-314adbd9-c2b3-408b-a04d-7c2ead6b9cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:44.739325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314adbd9-c2b3-408b-a04d-7c2ead6b9cfe None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:44.744684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0912d9835fe446248fa9a47a439f7ea6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:44.747834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:44.748740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:44.749616 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:44.750812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:44.751694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:44.755075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:44.760583 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0912d9835fe446248fa9a47a439f7ea6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:44.779793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0912d9835fe446248fa9a47a439f7ea6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:44.781095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0912d9835fe446248fa9a47a439f7ea6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:44.819646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-b885d4d8-7ed7-48b3-9804-ffd700163d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0912d9835fe446248fa9a47a439f7ea6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:44.830069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1194/2360] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:44 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:44.835753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:44.840028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:44.840761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1167/2361] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:46:44 2022] DELETE /identity/v3/users/0912d9835fe446248fa9a47a439f7ea6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:44.845669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e06cf-48b4-4a18-af93-2ff7f04c236a None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:44.845822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e06cf-48b4-4a18-af93-2ff7f04c236a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:44.846385 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e06cf-48b4-4a18-af93-2ff7f04c236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:44.900207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-db5e06cf-48b4-4a18-af93-2ff7f04c236a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:44.901988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-db5e06cf-48b4-4a18-af93-2ff7f04c236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:45.016436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1168/2362] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:45.030641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e06cf-48b4-4a18-af93-2ff7f04c236a None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.034684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640fc57-396a-4428-a08f-8f1707d89bb5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.036222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-db5e06cf-48b4-4a18-af93-2ff7f04c236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:45.053080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55078c44-ad5e-4c1d-8db8-c314cc7b6b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.053789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078c44-ad5e-4c1d-8db8-c314cc7b6b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.054067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078c44-ad5e-4c1d-8db8-c314cc7b6b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.054443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078c44-ad5e-4c1d-8db8-c314cc7b6b80 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.057315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078c44-ad5e-4c1d-8db8-c314cc7b6b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.071608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078c44-ad5e-4c1d-8db8-c314cc7b6b80 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.117046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1195/2363] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:44 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:45.120608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b4a6-d8fe-4992-a6f7-5a7fea64edc5 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.120888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b4a6-d8fe-4992-a6f7-5a7fea64edc5 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.122197 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b4a6-d8fe-4992-a6f7-5a7fea64edc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.168669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a477b4a6-d8fe-4992-a6f7-5a7fea64edc5 None None] MFA Rules not processed for user `97dcd026697f4ac099a2f518408b89ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:45.169862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a477b4a6-d8fe-4992-a6f7-5a7fea64edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:45.177933 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e06cf-48b4-4a18-af93-2ff7f04c236a None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.196991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d1320-d8ae-429c-8eb7-2155fde4ad02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.197764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d1320-d8ae-429c-8eb7-2155fde4ad02 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.198117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d1320-d8ae-429c-8eb7-2155fde4ad02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.198402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d1320-d8ae-429c-8eb7-2155fde4ad02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.221366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d1320-d8ae-429c-8eb7-2155fde4ad02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.223384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d1320-d8ae-429c-8eb7-2155fde4ad02 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.238532 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1169/2364] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:45.239815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d1320-d8ae-429c-8eb7-2155fde4ad02 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.252375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d1320-d8ae-429c-8eb7-2155fde4ad02 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.262176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.263253 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.264527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.265721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.267410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.269432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.294575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1170/2365] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:45.294796 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1196/2366] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:45.295753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b4a6-d8fe-4992-a6f7-5a7fea64edc5 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.298604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.300951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:45.318321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f05fa0-16e7-481f-a911-df91c8c93ddb admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.320851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b4a6-d8fe-4992-a6f7-5a7fea64edc5 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.327291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478e34-c50d-4207-9459-bb6b5d7b9d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.328825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478e34-c50d-4207-9459-bb6b5d7b9d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.329117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478e34-c50d-4207-9459-bb6b5d7b9d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.329402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478e34-c50d-4207-9459-bb6b5d7b9d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.330106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478e34-c50d-4207-9459-bb6b5d7b9d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.334018 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12defa4-0858-4b96-9a5e-45bba6049fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.335526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12defa4-0858-4b96-9a5e-45bba6049fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.336025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12defa4-0858-4b96-9a5e-45bba6049fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.336511 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12defa4-0858-4b96-9a5e-45bba6049fe1 admin admin] PATH_INFO: `/v3/projects/4916efd063a544e49e08fde7064e3977/users/b32741305a224ad69a0c8fd88b3863d0/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.339756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478e34-c50d-4207-9459-bb6b5d7b9d40 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.374122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12defa4-0858-4b96-9a5e-45bba6049fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4916efd063a544e49e08fde7064e3977, user_id=b32741305a224ad69a0c8fd88b3863d0, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.379367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12defa4-0858-4b96-9a5e-45bba6049fe1 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.387427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1171/2367] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:45 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:45.391720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478e34-c50d-4207-9459-bb6b5d7b9d40 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.396518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1197/2368] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:45 2022] PUT /identity/v3/projects/4916efd063a544e49e08fde7064e3977/users/b32741305a224ad69a0c8fd88b3863d0/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:45.400189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12defa4-0858-4b96-9a5e-45bba6049fe1 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.479810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478e34-c50d-4207-9459-bb6b5d7b9d40 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.493201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12defa4-0858-4b96-9a5e-45bba6049fe1 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.496710 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef90014-6f6b-4024-be24-6f226fcfac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.500174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef90014-6f6b-4024-be24-6f226fcfac9a admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.500458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef90014-6f6b-4024-be24-6f226fcfac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.501590 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef90014-6f6b-4024-be24-6f226fcfac9a admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.501703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16f65d-dfa5-447d-a01c-6d551bc1583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.502372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f65d-dfa5-447d-a01c-6d551bc1583a admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.502838 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f65d-dfa5-447d-a01c-6d551bc1583a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.503208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f65d-dfa5-447d-a01c-6d551bc1583a admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.504014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16f65d-dfa5-447d-a01c-6d551bc1583a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.505920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16f65d-dfa5-447d-a01c-6d551bc1583a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.511321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef90014-6f6b-4024-be24-6f226fcfac9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.521637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1198/2369] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:45.523117 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef90014-6f6b-4024-be24-6f226fcfac9a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.525335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16f65d-dfa5-447d-a01c-6d551bc1583a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.565134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16f65d-dfa5-447d-a01c-6d551bc1583a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.581045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.583008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.583467 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.583888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] PATH_INFO: `/v3/projects/4916efd063a544e49e08fde7064e3977/users/b32741305a224ad69a0c8fd88b3863d0/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.586690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1172/2370] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:45 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:46:45.587133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4916efd063a544e49e08fde7064e3977, user_id=b32741305a224ad69a0c8fd88b3863d0, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.590653 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.597306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef90014-6f6b-4024-be24-6f226fcfac9a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.608105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1199/2371] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:45 2022] PUT /identity/v3/projects/4916efd063a544e49e08fde7064e3977/users/b32741305a224ad69a0c8fd88b3863d0/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:45.643877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef90014-6f6b-4024-be24-6f226fcfac9a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.764473 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.766799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:45.813646 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64107ced-ff5c-498d-9796-310582dc62ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.815734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64107ced-ff5c-498d-9796-310582dc62ef admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.818243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64107ced-ff5c-498d-9796-310582dc62ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.818939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64107ced-ff5c-498d-9796-310582dc62ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.821537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64107ced-ff5c-498d-9796-310582dc62ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.825517 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64107ced-ff5c-498d-9796-310582dc62ef admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.860802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1173/2372] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:45.862685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64107ced-ff5c-498d-9796-310582dc62ef admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:45.897667 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64107ced-ff5c-498d-9796-310582dc62ef admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.928914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481577a-5f9b-4e05-bdcd-903a6f2b1748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.931261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481577a-5f9b-4e05-bdcd-903a6f2b1748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.931938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481577a-5f9b-4e05-bdcd-903a6f2b1748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.933308 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481577a-5f9b-4e05-bdcd-903a6f2b1748 admin admin] PATH_INFO: `/v3/projects/9279532c525148ef99b4b546fc9972c7/users/6d8f99c47b164d2cac9333209d4bcd0f/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.968647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29362873-3492-42ec-849b-b58acab14367 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:45.975479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:45.977440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:45.977689 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481577a-5f9b-4e05-bdcd-903a6f2b1748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9279532c525148ef99b4b546fc9972c7, user_id=6d8f99c47b164d2cac9333209d4bcd0f, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.978577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:45.979312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] PATH_INFO: `/v3/projects/c63579da2c2e4f83811bf1fa9e1d2048` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:45.982700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63579da2c2e4f83811bf1fa9e1d2048)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:45.984981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481577a-5f9b-4e05-bdcd-903a6f2b1748 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:45.988127 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:46.013582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1174/2373] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:45 2022] PUT /identity/v3/projects/9279532c525148ef99b4b546fc9972c7/users/6d8f99c47b164d2cac9333209d4bcd0f/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:46.020399 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481577a-5f9b-4e05-bdcd-903a6f2b1748 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:46.123390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63579da2c2e4f83811bf1fa9e1d2048', 'request_id': 'req-1cce4b44-3d07-4821-a908-a66c837cdd25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:46.165454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63579da2c2e4f83811bf1fa9e1d2048', 'request_id': 'req-1cce4b44-3d07-4821-a908-a66c837cdd25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:46.178773 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63579da2c2e4f83811bf1fa9e1d2048', 'request_id': 'req-1cce4b44-3d07-4821-a908-a66c837cdd25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:46.208857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] The token cache is being invalidate because project c63579da2c2e4f83811bf1fa9e1d2048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:46:46.209154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:46.210941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-1cce4b44-3d07-4821-a908-a66c837cdd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:46:46.220549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1200/2374] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:46:45 2022] DELETE /identity/v3/projects/c63579da2c2e4f83811bf1fa9e1d2048 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:46.222367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481577a-5f9b-4e05-bdcd-903a6f2b1748 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:46.223381 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18e74-04fa-41ab-a728-b8e4478203c0 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:46.223671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18e74-04fa-41ab-a728-b8e4478203c0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:46.223951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18e74-04fa-41ab-a728-b8e4478203c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:46.267096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-d9a18e74-04fa-41ab-a728-b8e4478203c0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:46.309998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-d9a18e74-04fa-41ab-a728-b8e4478203c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:46.431568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:46.432438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:46.435721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:46.436238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:46.438726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:46.441374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:46.459931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1175/2375] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:46.463702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:46.467417 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:46.483181 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1201/2376] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:46.486592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328546c-4dbb-4776-8ab9-ebc9f37f2db8 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:46.486935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328546c-4dbb-4776-8ab9-ebc9f37f2db8 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:46.487289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328546c-4dbb-4776-8ab9-ebc9f37f2db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:46.494206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a453a-e119-47fe-bb1b-1e7bb0e75b3b admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:46.507171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018443-3842-48b5-bfe7-9571630961c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:46.508071 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018443-3842-48b5-bfe7-9571630961c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:46.508352 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018443-3842-48b5-bfe7-9571630961c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:46.508626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12018443-3842-48b5-bfe7-9571630961c9 admin admin] PATH_INFO: `/v3/projects/9279532c525148ef99b4b546fc9972c7/users/6d8f99c47b164d2cac9333209d4bcd0f/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:46.512124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b328546c-4dbb-4776-8ab9-ebc9f37f2db8 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:46.512263 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12018443-3842-48b5-bfe7-9571630961c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9279532c525148ef99b4b546fc9972c7, user_id=6d8f99c47b164d2cac9333209d4bcd0f, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:46.513454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b328546c-4dbb-4776-8ab9-ebc9f37f2db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:46.515003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12018443-3842-48b5-bfe7-9571630961c9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:46.523331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1202/2377] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:46:46.527071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328546c-4dbb-4776-8ab9-ebc9f37f2db8 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:46.534588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1176/2378] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:46 2022] PUT /identity/v3/projects/9279532c525148ef99b4b546fc9972c7/users/6d8f99c47b164d2cac9333209d4bcd0f/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:46.546098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328546c-4dbb-4776-8ab9-ebc9f37f2db8 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:46.626270 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:46.627783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:46.628128 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:46.628476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:46.629293 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:46:46.629667 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:46.631439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:46.651817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1203/2379] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:46:46.653159 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018443-3842-48b5-bfe7-9571630961c9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:46.667288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12018443-3842-48b5-bfe7-9571630961c9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:46.683213 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478632a2-367d-4721-9c79-18e74c85aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:46.683898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478632a2-367d-4721-9c79-18e74c85aa0f admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:46.684179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478632a2-367d-4721-9c79-18e74c85aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:46.684595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478632a2-367d-4721-9c79-18e74c85aa0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:46.685300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478632a2-367d-4721-9c79-18e74c85aa0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:46.688927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478632a2-367d-4721-9c79-18e74c85aa0f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:46.758039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1177/2380] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:46:46 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:46.762449 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:46.778176 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327e599-fdb3-405c-94c6-54433e807aa2 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:47.025968 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001ecc-e5a2-43b5-b5c7-0ad50bd6da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:47.026937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001ecc-e5a2-43b5-b5c7-0ad50bd6da43 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:47.027244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001ecc-e5a2-43b5-b5c7-0ad50bd6da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:47.027561 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76001ecc-e5a2-43b5-b5c7-0ad50bd6da43 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:47.028620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76001ecc-e5a2-43b5-b5c7-0ad50bd6da43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:47.031387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76001ecc-e5a2-43b5-b5c7-0ad50bd6da43 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:47.083828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1204/2381] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:46:46 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:46:47.088330 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478632a2-367d-4721-9c79-18e74c85aa0f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:47.109734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478632a2-367d-4721-9c79-18e74c85aa0f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:47.120332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782924f-f7e2-4ba5-a4b6-51eebdf05553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:47.121096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782924f-f7e2-4ba5-a4b6-51eebdf05553 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:47.121401 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782924f-f7e2-4ba5-a4b6-51eebdf05553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:47.121701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782924f-f7e2-4ba5-a4b6-51eebdf05553 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:47.122447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782924f-f7e2-4ba5-a4b6-51eebdf05553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:47.136233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782924f-f7e2-4ba5-a4b6-51eebdf05553 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:47.166506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1178/2382] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:46:47.170397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001ecc-e5a2-43b5-b5c7-0ad50bd6da43 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:47.183526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76001ecc-e5a2-43b5-b5c7-0ad50bd6da43 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:47.210669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43548f54-d692-471f-92b3-678fe97caa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:47.212670 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548f54-d692-471f-92b3-678fe97caa57 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:47.212953 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548f54-d692-471f-92b3-678fe97caa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:47.213230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548f54-d692-471f-92b3-678fe97caa57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:47.213979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43548f54-d692-471f-92b3-678fe97caa57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:47.220671 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43548f54-d692-471f-92b3-678fe97caa57 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:47.244857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1205/2383] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:46:47.248658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782924f-f7e2-4ba5-a4b6-51eebdf05553 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:47.267129 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782924f-f7e2-4ba5-a4b6-51eebdf05553 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:47.276678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:47.277854 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:47.278426 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:47.279182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] PATH_INFO: `/v3/projects/acea6fb6fa724b1eac5123649d711528/users/901a5e4c69f044bda6e36690489f1c29/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:47.300076 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acea6fb6fa724b1eac5123649d711528, user_id=901a5e4c69f044bda6e36690489f1c29, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:47.303550 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:47.334300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1179/2384] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:46:47 2022] PUT /identity/v3/projects/acea6fb6fa724b1eac5123649d711528/users/901a5e4c69f044bda6e36690489f1c29/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:46:47.345059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec0070-64b5-40af-a65c-8d6575f10046 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:47.345348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec0070-64b5-40af-a65c-8d6575f10046 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:47.345683 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec0070-64b5-40af-a65c-8d6575f10046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:47.429326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b4ec0070-64b5-40af-a65c-8d6575f10046 None None] MFA Rules not processed for user `901a5e4c69f044bda6e36690489f1c29`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:47.431375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b4ec0070-64b5-40af-a65c-8d6575f10046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:47.569026 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1206/2385] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:47.587428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:47.589310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:47.672340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fd442-3230-4538-b808-5094967f5ef7 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:47.678778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fea774-72c8-4661-bd09-4656670fc359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:47.679608 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fea774-72c8-4661-bd09-4656670fc359 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:47.679894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fea774-72c8-4661-bd09-4656670fc359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:47.680171 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fea774-72c8-4661-bd09-4656670fc359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:47.698993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fea774-72c8-4661-bd09-4656670fc359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:47.700504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fea774-72c8-4661-bd09-4656670fc359 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:47.723475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1180/2386] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:50.785184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f9d9-03c0-47f6-9247-0e96f94969f9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:50.786485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f9d9-03c0-47f6-9247-0e96f94969f9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:50.786803 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f9d9-03c0-47f6-9247-0e96f94969f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:50.828005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-2101f9d9-03c0-47f6-9247-0e96f94969f9 None None] MFA Rules not processed for user `901a5e4c69f044bda6e36690489f1c29`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:50.831604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2101f9d9-03c0-47f6-9247-0e96f94969f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:50.859888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1207/2387] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:56.299771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396b4e-8fe7-4a85-b23d-e87e72814c59 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:56.300296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396b4e-8fe7-4a85-b23d-e87e72814c59 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:56.301652 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5396b4e-8fe7-4a85-b23d-e87e72814c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:56.362770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e5396b4e-8fe7-4a85-b23d-e87e72814c59 None None] MFA Rules not processed for user `b32741305a224ad69a0c8fd88b3863d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:56.369725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e5396b4e-8fe7-4a85-b23d-e87e72814c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:56.549980 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1181/2388] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:46:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:56.565592 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f9d9-03c0-47f6-9247-0e96f94969f9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:56.567840 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2101f9d9-03c0-47f6-9247-0e96f94969f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:56.686368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f9d9-03c0-47f6-9247-0e96f94969f9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:56.693114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:56.693771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:56.694052 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:56.694323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:56.696201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:56.764566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:56.766780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:56.782474 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1208/2389] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:00.729526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a181fc-75d1-4525-8bd9-7eced95316ca None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:00.733149 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a181fc-75d1-4525-8bd9-7eced95316ca None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:00.733511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a181fc-75d1-4525-8bd9-7eced95316ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:00.822072 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-49a181fc-75d1-4525-8bd9-7eced95316ca None None] MFA Rules not processed for user `6d8f99c47b164d2cac9333209d4bcd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:00.823612 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-49a181fc-75d1-4525-8bd9-7eced95316ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:01.023468 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1182/2390] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:01.404859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:01.407727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:01.433910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8a008-5044-4df0-90a5-df8683c21eb9 service nova] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:01.449630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9a954-19bb-4483-b7eb-5c7a347d095f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:01.451280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9a954-19bb-4483-b7eb-5c7a347d095f service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:01.452913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9a954-19bb-4483-b7eb-5c7a347d095f service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:01.455756 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9a954-19bb-4483-b7eb-5c7a347d095f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:01.459956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5ed9a954-19bb-4483-b7eb-5c7a347d095f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:01.591974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9a954-19bb-4483-b7eb-5c7a347d095f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:01.598848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9a954-19bb-4483-b7eb-5c7a347d095f service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:01.606652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1209/2391] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:03.395970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a181fc-75d1-4525-8bd9-7eced95316ca None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:03.398821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-49a181fc-75d1-4525-8bd9-7eced95316ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:03.474287 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a181fc-75d1-4525-8bd9-7eced95316ca None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:03.480009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:03.481144 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:03.481897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:03.482179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] PATH_INFO: `/v3/users/a0da24b472464de7a31f8dc127309700` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:03.483822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0da24b472464de7a31f8dc127309700)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:03.486249 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:03.574088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0da24b472464de7a31f8dc127309700'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:03.583958 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0da24b472464de7a31f8dc127309700'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:03.594781 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0da24b472464de7a31f8dc127309700'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:03.595918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0da24b472464de7a31f8dc127309700'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:03.613954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-1cef7e97-e907-4e67-8df6-b9b85ef2d4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0da24b472464de7a31f8dc127309700'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:03.628067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1183/2392] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:03 2022] DELETE /identity/v3/users/a0da24b472464de7a31f8dc127309700 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:03.632932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828461d0-5c4f-4479-ba77-5b98207b479c None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:03.633894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828461d0-5c4f-4479-ba77-5b98207b479c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:03.634115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828461d0-5c4f-4479-ba77-5b98207b479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:03.639420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132621-a131-4f75-8333-6fde268b77ff None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:03.640544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132621-a131-4f75-8333-6fde268b77ff None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:03.641164 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132621-a131-4f75-8333-6fde268b77ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:03.658030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-828461d0-5c4f-4479-ba77-5b98207b479c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:03.659157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-828461d0-5c4f-4479-ba77-5b98207b479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:03.688068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-85132621-a131-4f75-8333-6fde268b77ff None None] MFA Rules not processed for user `97dcd026697f4ac099a2f518408b89ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:03.689302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-85132621-a131-4f75-8333-6fde268b77ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:03.776756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1184/2393] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:03.809798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1210/2394] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:03.832075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85132621-a131-4f75-8333-6fde268b77ff None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:03.834712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-85132621-a131-4f75-8333-6fde268b77ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:03.947978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85132621-a131-4f75-8333-6fde268b77ff None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:03.953425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870d58f-09e7-47ce-8976-7cfd7e601b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:03.957296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870d58f-09e7-47ce-8976-7cfd7e601b5a service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:03.957671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870d58f-09e7-47ce-8976-7cfd7e601b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:03.958068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870d58f-09e7-47ce-8976-7cfd7e601b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:03.977472 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870d58f-09e7-47ce-8976-7cfd7e601b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:03.979006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870d58f-09e7-47ce-8976-7cfd7e601b5a service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:04.024475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1185/2395] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:04.547985 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828461d0-5c4f-4479-ba77-5b98207b479c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:04.551865 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-828461d0-5c4f-4479-ba77-5b98207b479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:04.586265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828461d0-5c4f-4479-ba77-5b98207b479c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:04.600193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:04.603273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:04.612069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:04.612926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] PATH_INFO: `/v3/projects/a97885bd324a420993a9779fb2b9caa9` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:04.616327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97885bd324a420993a9779fb2b9caa9)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:04.621937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:04.751260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97885bd324a420993a9779fb2b9caa9', 'request_id': 'req-15b08319-b5c0-41f6-be20-90563b798662'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:04.767569 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97885bd324a420993a9779fb2b9caa9', 'request_id': 'req-15b08319-b5c0-41f6-be20-90563b798662'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:04.775700 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97885bd324a420993a9779fb2b9caa9', 'request_id': 'req-15b08319-b5c0-41f6-be20-90563b798662'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:04.802847 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] The token cache is being invalidate because project a97885bd324a420993a9779fb2b9caa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:04.813557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:04.818257 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:04.822602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1211/2396] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:04 2022] DELETE /identity/v3/projects/a97885bd324a420993a9779fb2b9caa9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:04.828849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf4d7-d2a6-413a-ba2c-6d8264d3c518 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:04.829371 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf4d7-d2a6-413a-ba2c-6d8264d3c518 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:04.829680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bf4d7-d2a6-413a-ba2c-6d8264d3c518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:04.881042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-700bf4d7-d2a6-413a-ba2c-6d8264d3c518 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:04.882534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-700bf4d7-d2a6-413a-ba2c-6d8264d3c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:04.900831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:04.902503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:05.012331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1186/2397] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:05.021063 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645d39-b4e5-4553-8c4c-b42b1fcf5e97 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.021372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645d39-b4e5-4553-8c4c-b42b1fcf5e97 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.021657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645d39-b4e5-4553-8c4c-b42b1fcf5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.062891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b08319-b5c0-41f6-be20-90563b798662 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:05.084147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:05.090198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.090681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.091199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] PATH_INFO: `/v3/users/a17a147fe22f4668a4879df662e6cf10` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.095446 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17a147fe22f4668a4879df662e6cf10)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:05.100322 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:05.101322 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3b645d39-b4e5-4553-8c4c-b42b1fcf5e97 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:05.102949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3b645d39-b4e5-4553-8c4c-b42b1fcf5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:05.132635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1187/2398] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:05.140534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b645d39-b4e5-4553-8c4c-b42b1fcf5e97 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:05.169898 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b645d39-b4e5-4553-8c4c-b42b1fcf5e97 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:05.200809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:05.201627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.202002 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.203046 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.204231 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:05.207139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:05.210360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:05.239538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17a147fe22f4668a4879df662e6cf10'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:05.241257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1188/2399] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:05.246558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:05.251538 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17a147fe22f4668a4879df662e6cf10'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:05.260219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca1605-1318-4284-808a-448049ceab25 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:05.266571 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:05.267326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.267778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.268101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.269013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:05.270269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17a147fe22f4668a4879df662e6cf10'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:05.271111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17a147fe22f4668a4879df662e6cf10'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:05.271809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:05.297095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-24232d0e-db53-4e36-b471-cf61b147e689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17a147fe22f4668a4879df662e6cf10'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:05.306443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1212/2400] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:04 2022] DELETE /identity/v3/users/a17a147fe22f4668a4879df662e6cf10 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:47:05.313096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1934a8-ea68-4787-bda3-5523a3307388 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.313317 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1189/2401] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:05 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:05.314061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1934a8-ea68-4787-bda3-5523a3307388 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.314566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1934a8-ea68-4787-bda3-5523a3307388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.318553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:05.326618 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:05.345276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-ed1934a8-ea68-4787-bda3-5523a3307388 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:05.348936 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ed1934a8-ea68-4787-bda3-5523a3307388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:05.437656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f33dc-a3b7-4bbb-83eb-5e54546c9c5e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:05.448024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1213/2402] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:05.460290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1934a8-ea68-4787-bda3-5523a3307388 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:05.462172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-ed1934a8-ea68-4787-bda3-5523a3307388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:05.468974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60968e-bba8-4a64-995e-dbd647b9f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:05.469836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60968e-bba8-4a64-995e-dbd647b9f699 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.470126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60968e-bba8-4a64-995e-dbd647b9f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.470404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60968e-bba8-4a64-995e-dbd647b9f699 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.471699 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60968e-bba8-4a64-995e-dbd647b9f699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:05.473771 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60968e-bba8-4a64-995e-dbd647b9f699 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:05.560203 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1190/2403] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:05 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:05.562860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60968e-bba8-4a64-995e-dbd647b9f699 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:05.591257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60968e-bba8-4a64-995e-dbd647b9f699 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:05.603308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1934a8-ea68-4787-bda3-5523a3307388 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:05.605349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c8815-1dac-4eb5-8ba4-d4f102540189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:05.606044 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8815-1dac-4eb5-8ba4-d4f102540189 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.606595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8815-1dac-4eb5-8ba4-d4f102540189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.609340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8815-1dac-4eb5-8ba4-d4f102540189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.610145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c8815-1dac-4eb5-8ba4-d4f102540189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:05.614340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c8815-1dac-4eb5-8ba4-d4f102540189 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:05.617201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca3908-2859-4eef-90a7-8000ecbfed8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:05.618663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3908-2859-4eef-90a7-8000ecbfed8f service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.619219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3908-2859-4eef-90a7-8000ecbfed8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.619655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3908-2859-4eef-90a7-8000ecbfed8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.635506 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1191/2404] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:05.638343 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca3908-2859-4eef-90a7-8000ecbfed8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:05.640956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca3908-2859-4eef-90a7-8000ecbfed8f service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:05.641865 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c8815-1dac-4eb5-8ba4-d4f102540189 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:05.664299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c8815-1dac-4eb5-8ba4-d4f102540189 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:05.669869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1214/2405] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:47:05.670320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92db75-bd7e-4bf5-8e1b-4fca3ec88d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:05.672073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92db75-bd7e-4bf5-8e1b-4fca3ec88d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.672700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92db75-bd7e-4bf5-8e1b-4fca3ec88d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.672982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92db75-bd7e-4bf5-8e1b-4fca3ec88d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.674337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92db75-bd7e-4bf5-8e1b-4fca3ec88d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:05.676629 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92db75-bd7e-4bf5-8e1b-4fca3ec88d52 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:05.692017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1192/2406] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:05.698374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca3908-2859-4eef-90a7-8000ecbfed8f service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:05.722452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca3908-2859-4eef-90a7-8000ecbfed8f service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:05.732021 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0402-011d-4b27-a255-bf958cd107b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:05.742283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0402-011d-4b27-a255-bf958cd107b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.742768 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0402-011d-4b27-a255-bf958cd107b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.744069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0402-011d-4b27-a255-bf958cd107b0 admin admin] PATH_INFO: `/v3/projects/aae4278fddbd44cbb508e4fa63f9f7a4/users/80f1e7854604414e8174b87e039ef401/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.774729 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e0402-011d-4b27-a255-bf958cd107b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae4278fddbd44cbb508e4fa63f9f7a4, user_id=80f1e7854604414e8174b87e039ef401, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:05.778888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e0402-011d-4b27-a255-bf958cd107b0 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:05.810005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1215/2407] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:05 2022] PUT /identity/v3/projects/aae4278fddbd44cbb508e4fa63f9f7a4/users/80f1e7854604414e8174b87e039ef401/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:05.817084 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294073-de46-40ee-9d05-f7fee6a9b2e6 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:05.817610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294073-de46-40ee-9d05-f7fee6a9b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:05.818264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294073-de46-40ee-9d05-f7fee6a9b2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:05.869300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-34294073-de46-40ee-9d05-f7fee6a9b2e6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:05.888648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-34294073-de46-40ee-9d05-f7fee6a9b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:06.063029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1193/2408] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:06.097340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0402-011d-4b27-a255-bf958cd107b0 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:06.218884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0402-011d-4b27-a255-bf958cd107b0 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:06.230424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21092d76-fbec-48a3-a367-9f26e71b8b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:06.231423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092d76-fbec-48a3-a367-9f26e71b8b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:06.231776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092d76-fbec-48a3-a367-9f26e71b8b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:06.232017 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092d76-fbec-48a3-a367-9f26e71b8b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:06.259149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21092d76-fbec-48a3-a367-9f26e71b8b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:06.270007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21092d76-fbec-48a3-a367-9f26e71b8b8b service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:06.290861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1216/2409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:06.454639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34294073-de46-40ee-9d05-f7fee6a9b2e6 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:06.459457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-34294073-de46-40ee-9d05-f7fee6a9b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:06.656597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34294073-de46-40ee-9d05-f7fee6a9b2e6 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:06.672314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:06.676217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:06.676499 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:06.676770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] PATH_INFO: `/v3/projects/5cc182d957a24831801e62ab23f76cc1` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:06.681305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc182d957a24831801e62ab23f76cc1)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:06.687113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:06.795443 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc182d957a24831801e62ab23f76cc1', 'request_id': 'req-a5bc944e-fa71-495e-b5ad-07c4664b8c88'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:06.812274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc182d957a24831801e62ab23f76cc1', 'request_id': 'req-a5bc944e-fa71-495e-b5ad-07c4664b8c88'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:06.831382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc182d957a24831801e62ab23f76cc1', 'request_id': 'req-a5bc944e-fa71-495e-b5ad-07c4664b8c88'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:06.846141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] The token cache is being invalidate because project 5cc182d957a24831801e62ab23f76cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:06.846516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:06.847451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-a5bc944e-fa71-495e-b5ad-07c4664b8c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:06.849968 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1194/2410] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:06 2022] DELETE /identity/v3/projects/5cc182d957a24831801e62ab23f76cc1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:06.854876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21092d76-fbec-48a3-a367-9f26e71b8b8b service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:06.966472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21092d76-fbec-48a3-a367-9f26e71b8b8b service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:07.067711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:07.069578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:07.070022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:07.070574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] PATH_INFO: `/v3/users/5bba12f26995416da049ac4fbe927f8a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:07.072037 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bba12f26995416da049ac4fbe927f8a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:07.073986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:07.180204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bba12f26995416da049ac4fbe927f8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:07.193541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bba12f26995416da049ac4fbe927f8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:07.204749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bba12f26995416da049ac4fbe927f8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:07.205410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bba12f26995416da049ac4fbe927f8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:07.223872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bba12f26995416da049ac4fbe927f8a'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:07.232272 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1217/2411] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:06 2022] DELETE /identity/v3/users/5bba12f26995416da049ac4fbe927f8a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:07.680835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548302-d742-48d9-8ef8-ccf32ee45464 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:07.681672 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548302-d742-48d9-8ef8-ccf32ee45464 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:07.682122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7548302-d742-48d9-8ef8-ccf32ee45464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:07.720502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d7548302-d742-48d9-8ef8-ccf32ee45464 None None] MFA Rules not processed for user `80f1e7854604414e8174b87e039ef401`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:07.721967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d7548302-d742-48d9-8ef8-ccf32ee45464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:07.771264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:07.772896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:07.887656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1195/2412] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:07.905937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7548302-d742-48d9-8ef8-ccf32ee45464 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:07.908456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d7548302-d742-48d9-8ef8-ccf32ee45464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:07.909415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ea5bd-722c-41c2-abbb-682f26a76d44 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:07.922302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:07.923519 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:07.923975 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:07.924433 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] PATH_INFO: `/v3/projects/2ac6430ab25f4aaf8e9c3fc14da1f9b7` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:07.926714 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac6430ab25f4aaf8e9c3fc14da1f9b7)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:07.929444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:08.005265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac6430ab25f4aaf8e9c3fc14da1f9b7', 'request_id': 'req-8b2152b5-c284-467c-9858-ae06eee55c25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:08.022429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac6430ab25f4aaf8e9c3fc14da1f9b7', 'request_id': 'req-8b2152b5-c284-467c-9858-ae06eee55c25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:08.031835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac6430ab25f4aaf8e9c3fc14da1f9b7', 'request_id': 'req-8b2152b5-c284-467c-9858-ae06eee55c25'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:08.050497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] The token cache is being invalidate because project 2ac6430ab25f4aaf8e9c3fc14da1f9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:08.051294 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:08.053340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-8b2152b5-c284-467c-9858-ae06eee55c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:08.055581 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1218/2413] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:07 2022] DELETE /identity/v3/projects/2ac6430ab25f4aaf8e9c3fc14da1f9b7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:08.065543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7548302-d742-48d9-8ef8-ccf32ee45464 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:08.065920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567233-0764-4f49-aeec-16c2e3bbb08c None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.066397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567233-0764-4f49-aeec-16c2e3bbb08c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.067009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567233-0764-4f49-aeec-16c2e3bbb08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.155886 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b4d0-015e-442d-95eb-91b200021171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:08.156919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b4d0-015e-442d-95eb-91b200021171 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.157273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b4d0-015e-442d-95eb-91b200021171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.157664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b4d0-015e-442d-95eb-91b200021171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.159852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-7c25b4d0-015e-442d-95eb-91b200021171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:08.189510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c7567233-0764-4f49-aeec-16c2e3bbb08c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:08.191740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c7567233-0764-4f49-aeec-16c2e3bbb08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:08.254340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b4d0-015e-442d-95eb-91b200021171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:08.256269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b4d0-015e-442d-95eb-91b200021171 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:08.270373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1196/2414] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:47:08.318114 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1219/2415] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:08.325656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a24b-3fd4-4c37-ad30-ed63cb1334c7 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.326222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a24b-3fd4-4c37-ad30-ed63cb1334c7 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.326687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a24b-3fd4-4c37-ad30-ed63cb1334c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.350668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-9aa1a24b-3fd4-4c37-ad30-ed63cb1334c7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:08.352004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9aa1a24b-3fd4-4c37-ad30-ed63cb1334c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:08.363094 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1197/2416] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:08.369045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567233-0764-4f49-aeec-16c2e3bbb08c None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:08.386450 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567233-0764-4f49-aeec-16c2e3bbb08c None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:08.396236 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:08.397140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.397582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.398157 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.399103 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:08.399415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:08.401031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:08.414154 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1220/2417] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:08.418107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a24b-3fd4-4c37-ad30-ed63cb1334c7 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:08.428893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a24b-3fd4-4c37-ad30-ed63cb1334c7 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:08.434607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6074-2667-48f7-9de0-dca5b9161fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:08.435346 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6074-2667-48f7-9de0-dca5b9161fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.435780 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6074-2667-48f7-9de0-dca5b9161fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.436228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa6074-2667-48f7-9de0-dca5b9161fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.437619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa6074-2667-48f7-9de0-dca5b9161fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:08.439748 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa6074-2667-48f7-9de0-dca5b9161fc9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:08.490125 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1198/2418] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:08 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:08.494556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:08.507569 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8815cd-d387-4edd-a221-348a0dcb7ba2 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:08.593612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479815f7-ea72-4f71-bacc-edc2a7e980c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:08.594666 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479815f7-ea72-4f71-bacc-edc2a7e980c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.595144 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479815f7-ea72-4f71-bacc-edc2a7e980c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.595608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479815f7-ea72-4f71-bacc-edc2a7e980c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.596546 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479815f7-ea72-4f71-bacc-edc2a7e980c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:08.598752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479815f7-ea72-4f71-bacc-edc2a7e980c4 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:08.631023 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1221/2419] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:08 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:47:08.634440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6074-2667-48f7-9de0-dca5b9161fc9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:08.659182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa6074-2667-48f7-9de0-dca5b9161fc9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:08.665847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8aaca-2e4d-41b8-87f8-a32a166e98da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:08.666645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8aaca-2e4d-41b8-87f8-a32a166e98da admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.667088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8aaca-2e4d-41b8-87f8-a32a166e98da admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.667461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8aaca-2e4d-41b8-87f8-a32a166e98da admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.668293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8aaca-2e4d-41b8-87f8-a32a166e98da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:08.670003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8aaca-2e4d-41b8-87f8-a32a166e98da admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:08.681616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1199/2420] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:47:08.686260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479815f7-ea72-4f71-bacc-edc2a7e980c4 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:08.698646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479815f7-ea72-4f71-bacc-edc2a7e980c4 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:08.709117 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a653b38-962e-45ba-ba23-239e1ed70f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:08.709870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653b38-962e-45ba-ba23-239e1ed70f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.710150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653b38-962e-45ba-ba23-239e1ed70f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.710424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653b38-962e-45ba-ba23-239e1ed70f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.711378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a653b38-962e-45ba-ba23-239e1ed70f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:08.713423 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a653b38-962e-45ba-ba23-239e1ed70f6c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:08.727545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1222/2421] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:08.733751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8aaca-2e4d-41b8-87f8-a32a166e98da admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:08.748237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8aaca-2e4d-41b8-87f8-a32a166e98da admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:08.753320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb21f4-8000-4fee-8da8-e672484e5ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:08.754306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb21f4-8000-4fee-8da8-e672484e5ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.754688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb21f4-8000-4fee-8da8-e672484e5ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.755691 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb21f4-8000-4fee-8da8-e672484e5ded admin admin] PATH_INFO: `/v3/projects/5a4a773ffa484ab395fc14578441a5f0/users/f80632bcef114c56a31e1a55f5f114e7/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.784625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb21f4-8000-4fee-8da8-e672484e5ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4a773ffa484ab395fc14578441a5f0, user_id=f80632bcef114c56a31e1a55f5f114e7, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:08.787496 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb21f4-8000-4fee-8da8-e672484e5ded admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:08.805785 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1200/2422] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:08 2022] PUT /identity/v3/projects/5a4a773ffa484ab395fc14578441a5f0/users/f80632bcef114c56a31e1a55f5f114e7/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:08.817219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f7d50-f402-447c-886e-b7beeb3fe8b1 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.817559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f7d50-f402-447c-886e-b7beeb3fe8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.817871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f7d50-f402-447c-886e-b7beeb3fe8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.854206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-dd1f7d50-f402-447c-886e-b7beeb3fe8b1 None None] MFA Rules not processed for user `f80632bcef114c56a31e1a55f5f114e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:08.854814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-dd1f7d50-f402-447c-886e-b7beeb3fe8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:08.925554 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1223/2423] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:08.930474 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb21f4-8000-4fee-8da8-e672484e5ded admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:08.989476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb21f4-8000-4fee-8da8-e672484e5ded admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:08.993992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c4e5-acec-4715-ad56-2e015d1233ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:08.994695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c4e5-acec-4715-ad56-2e015d1233ca admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:08.995012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c4e5-acec-4715-ad56-2e015d1233ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:08.995290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c4e5-acec-4715-ad56-2e015d1233ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:08.995967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28c4e5-acec-4715-ad56-2e015d1233ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:08.997849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28c4e5-acec-4715-ad56-2e015d1233ca admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:09.023053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1201/2424] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:08 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:09.027094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f7d50-f402-447c-886e-b7beeb3fe8b1 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:09.037681 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f7d50-f402-447c-886e-b7beeb3fe8b1 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:09.094394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ce959-713d-401a-b72b-9e3c4bc88362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:09.095131 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ce959-713d-401a-b72b-9e3c4bc88362 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:09.095411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ce959-713d-401a-b72b-9e3c4bc88362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:09.095677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ce959-713d-401a-b72b-9e3c4bc88362 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:09.096361 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ce959-713d-401a-b72b-9e3c4bc88362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:09.098255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ce959-713d-401a-b72b-9e3c4bc88362 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:09.121717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1224/2425] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:09 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:09.126523 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c4e5-acec-4715-ad56-2e015d1233ca admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:09.137104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c4e5-acec-4715-ad56-2e015d1233ca admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:09.142408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9266-3f7d-4986-bbb1-9e8aae1333e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:09.143175 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9266-3f7d-4986-bbb1-9e8aae1333e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:09.143538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9266-3f7d-4986-bbb1-9e8aae1333e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:09.143885 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9266-3f7d-4986-bbb1-9e8aae1333e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:09.144684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c9266-3f7d-4986-bbb1-9e8aae1333e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:09.146372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c9266-3f7d-4986-bbb1-9e8aae1333e4 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:09.158025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1202/2426] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:47:09.162338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ce959-713d-401a-b72b-9e3c4bc88362 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:09.172450 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ce959-713d-401a-b72b-9e3c4bc88362 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:09.178005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f3665-150d-4631-9574-5487b9bbe53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:09.178910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f3665-150d-4631-9574-5487b9bbe53a admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:09.179218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f3665-150d-4631-9574-5487b9bbe53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:09.179492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f3665-150d-4631-9574-5487b9bbe53a admin admin] PATH_INFO: `/v3/projects/00e7c8a247f44e2fb909073931330ec0/users/fd2060b116cd431b89eb970e8d05bd44/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:09.195492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f3665-150d-4631-9574-5487b9bbe53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e7c8a247f44e2fb909073931330ec0, user_id=fd2060b116cd431b89eb970e8d05bd44, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:09.198221 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f3665-150d-4631-9574-5487b9bbe53a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:09.212124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1225/2427] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:09 2022] PUT /identity/v3/projects/00e7c8a247f44e2fb909073931330ec0/users/fd2060b116cd431b89eb970e8d05bd44/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:47:09.216152 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9266-3f7d-4986-bbb1-9e8aae1333e4 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:09.228080 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9266-3f7d-4986-bbb1-9e8aae1333e4 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:09.294377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f4286-d403-4ef5-b93d-67cade3e5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:09.295079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4286-d403-4ef5-b93d-67cade3e5e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:09.295365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4286-d403-4ef5-b93d-67cade3e5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:09.296305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4286-d403-4ef5-b93d-67cade3e5e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:09.297168 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f4286-d403-4ef5-b93d-67cade3e5e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:09.299328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f4286-d403-4ef5-b93d-67cade3e5e8a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:09.316273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1203/2428] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:09.317853 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f3665-150d-4631-9574-5487b9bbe53a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:09.328155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f3665-150d-4631-9574-5487b9bbe53a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:09.333066 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:09.333930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:09.334206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:09.334476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] PATH_INFO: `/v3/projects/00e7c8a247f44e2fb909073931330ec0/users/fd2060b116cd431b89eb970e8d05bd44/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:09.336468 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e7c8a247f44e2fb909073931330ec0, user_id=fd2060b116cd431b89eb970e8d05bd44, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:09.339507 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:09.351442 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1226/2429] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:09 2022] PUT /identity/v3/projects/00e7c8a247f44e2fb909073931330ec0/users/fd2060b116cd431b89eb970e8d05bd44/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:47:09.362483 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e888e-82ed-44ad-9652-22c25a61dd34 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:09.362817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e888e-82ed-44ad-9652-22c25a61dd34 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:09.363109 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e888e-82ed-44ad-9652-22c25a61dd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:09.391413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-180e888e-82ed-44ad-9652-22c25a61dd34 None None] MFA Rules not processed for user `fd2060b116cd431b89eb970e8d05bd44`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:09.392732 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-180e888e-82ed-44ad-9652-22c25a61dd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:09.468912 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1204/2430] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:09.480115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:09.481885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:09.568290 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b7c46-0462-487c-835b-9c24ac592198 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:09.572694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa983fe2-a687-499e-83a4-72af36ee9d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:09.573476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983fe2-a687-499e-83a4-72af36ee9d5f service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:09.573874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983fe2-a687-499e-83a4-72af36ee9d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:09.574163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa983fe2-a687-499e-83a4-72af36ee9d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:09.584655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa983fe2-a687-499e-83a4-72af36ee9d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:09.586091 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa983fe2-a687-499e-83a4-72af36ee9d5f service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:09.598741 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1227/2431] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:09.740574 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e888e-82ed-44ad-9652-22c25a61dd34 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:09.751673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e888e-82ed-44ad-9652-22c25a61dd34 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:09.762665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81829fda-ebe8-4998-a8a0-ba2625a41aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:09.763516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81829fda-ebe8-4998-a8a0-ba2625a41aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:09.763992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81829fda-ebe8-4998-a8a0-ba2625a41aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:09.764271 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81829fda-ebe8-4998-a8a0-ba2625a41aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:09.853435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81829fda-ebe8-4998-a8a0-ba2625a41aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:09.855047 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81829fda-ebe8-4998-a8a0-ba2625a41aa3 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:09.864938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1205/2432] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:47:10.277075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42926e-7e0a-4f3e-ad67-5a2bff7cf96d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:10.278015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42926e-7e0a-4f3e-ad67-5a2bff7cf96d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:10.278306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42926e-7e0a-4f3e-ad67-5a2bff7cf96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:10.297913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8e42926e-7e0a-4f3e-ad67-5a2bff7cf96d None None] MFA Rules not processed for user `80f1e7854604414e8174b87e039ef401`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:10.299167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8e42926e-7e0a-4f3e-ad67-5a2bff7cf96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:10.360476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1228/2433] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:12.655533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81829fda-ebe8-4998-a8a0-ba2625a41aa3 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:12.728487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81829fda-ebe8-4998-a8a0-ba2625a41aa3 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:12.734769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:12.735678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:12.735958 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:12.736232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] PATH_INFO: `/v3/users/f80632bcef114c56a31e1a55f5f114e7` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:12.737437 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80632bcef114c56a31e1a55f5f114e7)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:12.739504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:12.787609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80632bcef114c56a31e1a55f5f114e7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:12.794764 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80632bcef114c56a31e1a55f5f114e7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:12.802850 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80632bcef114c56a31e1a55f5f114e7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:12.803368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80632bcef114c56a31e1a55f5f114e7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:12.821222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80632bcef114c56a31e1a55f5f114e7'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:12.828232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1206/2434] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:12 2022] DELETE /identity/v3/users/f80632bcef114c56a31e1a55f5f114e7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:12.832693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef0d2-d7d2-4d4b-9335-09bb62aaea15 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:12.833191 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef0d2-d7d2-4d4b-9335-09bb62aaea15 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:12.833386 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef0d2-d7d2-4d4b-9335-09bb62aaea15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:12.850874 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-326ef0d2-d7d2-4d4b-9335-09bb62aaea15 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:12.852120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-326ef0d2-d7d2-4d4b-9335-09bb62aaea15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:12.927342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1229/2435] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:12.937372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:12.938761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:13.018199 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4beb4-58d7-4a8f-874a-01775348d3e4 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:13.022295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dee6b-72f2-48be-91ad-baabfa2513c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:13.023415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dee6b-72f2-48be-91ad-baabfa2513c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:13.023729 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dee6b-72f2-48be-91ad-baabfa2513c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:13.023965 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dee6b-72f2-48be-91ad-baabfa2513c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:13.034375 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dee6b-72f2-48be-91ad-baabfa2513c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:13.036011 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dee6b-72f2-48be-91ad-baabfa2513c8 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:13.048059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1207/2436] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:13.447540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ef0d2-d7d2-4d4b-9335-09bb62aaea15 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:13.449214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-326ef0d2-d7d2-4d4b-9335-09bb62aaea15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:13.489195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ef0d2-d7d2-4d4b-9335-09bb62aaea15 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:13.493952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:13.494898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:13.495280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:13.495625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] PATH_INFO: `/v3/projects/5a4a773ffa484ab395fc14578441a5f0` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:13.496890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4a773ffa484ab395fc14578441a5f0)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:13.498931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:13.552075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4a773ffa484ab395fc14578441a5f0', 'request_id': 'req-51443609-1472-48b1-b896-66329a7521f5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.559642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4a773ffa484ab395fc14578441a5f0', 'request_id': 'req-51443609-1472-48b1-b896-66329a7521f5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.565082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4a773ffa484ab395fc14578441a5f0', 'request_id': 'req-51443609-1472-48b1-b896-66329a7521f5'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.575891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] The token cache is being invalidate because project 5a4a773ffa484ab395fc14578441a5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:13.576189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.576854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.578408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1230/2437] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:13 2022] DELETE /identity/v3/projects/5a4a773ffa484ab395fc14578441a5f0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:13.582363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dee6b-72f2-48be-91ad-baabfa2513c8 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:13.591823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dee6b-72f2-48be-91ad-baabfa2513c8 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:13.651930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:13.652789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:13.653069 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:13.653349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] PATH_INFO: `/v3/users/fd2060b116cd431b89eb970e8d05bd44` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:13.654519 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2060b116cd431b89eb970e8d05bd44)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:13.656972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:13.701435 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2060b116cd431b89eb970e8d05bd44'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.708454 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2060b116cd431b89eb970e8d05bd44'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.719915 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2060b116cd431b89eb970e8d05bd44'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.720717 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2060b116cd431b89eb970e8d05bd44'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.732857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-faa646d5-4b09-4a0d-8ac6-f138fc8e6f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2060b116cd431b89eb970e8d05bd44'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:13.739316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1208/2438] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:13 2022] DELETE /identity/v3/users/fd2060b116cd431b89eb970e8d05bd44 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:14.011605 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.013140 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:14.026612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51443609-1472-48b1-b896-66329a7521f5 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.083558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.084428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.084709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.084983 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] PATH_INFO: `/v3/projects/00e7c8a247f44e2fb909073931330ec0` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.086153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e7c8a247f44e2fb909073931330ec0)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.088124 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.135346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e7c8a247f44e2fb909073931330ec0', 'request_id': 'req-57e4fe95-477f-412e-9062-b591cce67fe7'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:14.142558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e7c8a247f44e2fb909073931330ec0', 'request_id': 'req-57e4fe95-477f-412e-9062-b591cce67fe7'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:14.148049 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e7c8a247f44e2fb909073931330ec0', 'request_id': 'req-57e4fe95-477f-412e-9062-b591cce67fe7'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:14.159529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] The token cache is being invalidate because project 00e7c8a247f44e2fb909073931330ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:14.159833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:14.160466 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-57e4fe95-477f-412e-9062-b591cce67fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:14.162303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1231/2439] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:14 2022] DELETE /identity/v3/projects/00e7c8a247f44e2fb909073931330ec0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:14.167419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ba50-142a-43ee-8092-87868d5abc2d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.167712 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ba50-142a-43ee-8092-87868d5abc2d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.167993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18ba50-142a-43ee-8092-87868d5abc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.186838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-4e18ba50-142a-43ee-8092-87868d5abc2d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:14.188079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-4e18ba50-142a-43ee-8092-87868d5abc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:14.250592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1209/2440] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:14.259938 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cc90-ffc2-4347-b2c3-89e7ee97ee0d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.260159 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cc90-ffc2-4347-b2c3-89e7ee97ee0d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.260439 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cc90-ffc2-4347-b2c3-89e7ee97ee0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.283607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-02b8cc90-ffc2-4347-b2c3-89e7ee97ee0d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:14.284845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-02b8cc90-ffc2-4347-b2c3-89e7ee97ee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:14.292933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1232/2441] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:14.297809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18ba50-142a-43ee-8092-87868d5abc2d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.309137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18ba50-142a-43ee-8092-87868d5abc2d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.321209 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.321894 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.322173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.322441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.323216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:14.323520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.326276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.338190 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1210/2442] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:14.343201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8cc90-ffc2-4347-b2c3-89e7ee97ee0d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.352327 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8cc90-ffc2-4347-b2c3-89e7ee97ee0d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.357097 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b66ce-1856-4c25-862d-a7f095ae1549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.357744 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b66ce-1856-4c25-862d-a7f095ae1549 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.358025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b66ce-1856-4c25-862d-a7f095ae1549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.358362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b66ce-1856-4c25-862d-a7f095ae1549 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.360094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b66ce-1856-4c25-862d-a7f095ae1549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.361977 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b66ce-1856-4c25-862d-a7f095ae1549 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.393039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1233/2443] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:14 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:14.397070 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.407783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479659c-2934-4dfd-9f84-d306f9672413 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.470414 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4b271-7178-4d0b-afc6-b25cd86d38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.471288 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4b271-7178-4d0b-afc6-b25cd86d38fa admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.471591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4b271-7178-4d0b-afc6-b25cd86d38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.471878 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4b271-7178-4d0b-afc6-b25cd86d38fa admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.475945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4b271-7178-4d0b-afc6-b25cd86d38fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.477448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4b271-7178-4d0b-afc6-b25cd86d38fa admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.506091 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1211/2444] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:14 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:47:14.507585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b66ce-1856-4c25-862d-a7f095ae1549 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.519119 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b66ce-1856-4c25-862d-a7f095ae1549 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.524500 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a200a-1245-480b-b473-435e36dac9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.525162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a200a-1245-480b-b473-435e36dac9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.525440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a200a-1245-480b-b473-435e36dac9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.525714 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a200a-1245-480b-b473-435e36dac9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.526472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a200a-1245-480b-b473-435e36dac9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.528210 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a200a-1245-480b-b473-435e36dac9d7 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.543510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1234/2445] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:47:14.545968 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4b271-7178-4d0b-afc6-b25cd86d38fa admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.556722 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4b271-7178-4d0b-afc6-b25cd86d38fa admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.561478 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062ab2f-9693-40e2-808a-856afbaad54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.562273 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062ab2f-9693-40e2-808a-856afbaad54a admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.562559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062ab2f-9693-40e2-808a-856afbaad54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.562836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062ab2f-9693-40e2-808a-856afbaad54a admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.563605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062ab2f-9693-40e2-808a-856afbaad54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.565201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062ab2f-9693-40e2-808a-856afbaad54a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.577504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1212/2446] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:14.581389 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a200a-1245-480b-b473-435e36dac9d7 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.591061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a200a-1245-480b-b473-435e36dac9d7 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.596214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb869620-582d-488c-9c0c-3d7b13a3f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.597085 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869620-582d-488c-9c0c-3d7b13a3f87c admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.597363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869620-582d-488c-9c0c-3d7b13a3f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.597633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869620-582d-488c-9c0c-3d7b13a3f87c admin admin] PATH_INFO: `/v3/projects/bdfd68ef2ca248a7bfa76e2f114ed846/users/56eca6c1c54d45648b530ef2928ec480/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.612203 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb869620-582d-488c-9c0c-3d7b13a3f87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfd68ef2ca248a7bfa76e2f114ed846, user_id=56eca6c1c54d45648b530ef2928ec480, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.614861 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb869620-582d-488c-9c0c-3d7b13a3f87c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.630186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1235/2447] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:14 2022] PUT /identity/v3/projects/bdfd68ef2ca248a7bfa76e2f114ed846/users/56eca6c1c54d45648b530ef2928ec480/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:14.641075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce01881-593d-4d41-b15c-432d322d2b2d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.641363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce01881-593d-4d41-b15c-432d322d2b2d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.641641 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce01881-593d-4d41-b15c-432d322d2b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.673993 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3ce01881-593d-4d41-b15c-432d322d2b2d None None] MFA Rules not processed for user `56eca6c1c54d45648b530ef2928ec480`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:14.675351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3ce01881-593d-4d41-b15c-432d322d2b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:14.751367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1213/2448] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:14.756785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb869620-582d-488c-9c0c-3d7b13a3f87c admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.823565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb869620-582d-488c-9c0c-3d7b13a3f87c admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.828967 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa128-bea9-4f71-8b0c-348f399c2d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.829624 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa128-bea9-4f71-8b0c-348f399c2d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.829911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa128-bea9-4f71-8b0c-348f399c2d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.830186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa128-bea9-4f71-8b0c-348f399c2d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.830869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caa128-bea9-4f71-8b0c-348f399c2d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.832790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caa128-bea9-4f71-8b0c-348f399c2d93 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.861973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1236/2449] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:14 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:14.866066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce01881-593d-4d41-b15c-432d322d2b2d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.878243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce01881-593d-4d41-b15c-432d322d2b2d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.943559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb1e8a-1982-4397-a2a2-8aa92d80777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.944364 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb1e8a-1982-4397-a2a2-8aa92d80777b admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.944887 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb1e8a-1982-4397-a2a2-8aa92d80777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.945347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb1e8a-1982-4397-a2a2-8aa92d80777b admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.947680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb1e8a-1982-4397-a2a2-8aa92d80777b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.949720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb1e8a-1982-4397-a2a2-8aa92d80777b admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:14.970983 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1214/2450] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:14 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:14.974846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa128-bea9-4f71-8b0c-348f399c2d93 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:14.984872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa128-bea9-4f71-8b0c-348f399c2d93 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:14.989362 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff4b68-ab9a-4c7e-b83b-5594e3fe8478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:14.990011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4b68-ab9a-4c7e-b83b-5594e3fe8478 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:14.990296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4b68-ab9a-4c7e-b83b-5594e3fe8478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:14.990574 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4b68-ab9a-4c7e-b83b-5594e3fe8478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:14.991325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff4b68-ab9a-4c7e-b83b-5594e3fe8478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:14.992894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff4b68-ab9a-4c7e-b83b-5594e3fe8478 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:15.009057 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1237/2451] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:15.010374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb1e8a-1982-4397-a2a2-8aa92d80777b admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:15.021695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb1e8a-1982-4397-a2a2-8aa92d80777b admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:15.026707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5345f41-3091-4a78-837c-2d7afc89c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:15.027626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5345f41-3091-4a78-837c-2d7afc89c645 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:15.027900 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5345f41-3091-4a78-837c-2d7afc89c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:15.028169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5345f41-3091-4a78-837c-2d7afc89c645 admin admin] PATH_INFO: `/v3/projects/cf746cf2d9414ff98cc5061606d44a25/users/26a60ef38320483eb6f265d03654582c/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:15.042377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5345f41-3091-4a78-837c-2d7afc89c645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf746cf2d9414ff98cc5061606d44a25, user_id=26a60ef38320483eb6f265d03654582c, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:15.045111 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5345f41-3091-4a78-837c-2d7afc89c645 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:15.058721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1215/2452] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:15 2022] PUT /identity/v3/projects/cf746cf2d9414ff98cc5061606d44a25/users/26a60ef38320483eb6f265d03654582c/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:15.063770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff4b68-ab9a-4c7e-b83b-5594e3fe8478 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:15.076061 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff4b68-ab9a-4c7e-b83b-5594e3fe8478 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:15.148484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eed6dc-10af-4a82-88cb-e9912d88b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:15.149277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed6dc-10af-4a82-88cb-e9912d88b036 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:15.149637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed6dc-10af-4a82-88cb-e9912d88b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:15.150001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed6dc-10af-4a82-88cb-e9912d88b036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:15.150808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eed6dc-10af-4a82-88cb-e9912d88b036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:15.152632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eed6dc-10af-4a82-88cb-e9912d88b036 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:15.166347 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1238/2453] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:15.170890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5345f41-3091-4a78-837c-2d7afc89c645 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:15.183363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5345f41-3091-4a78-837c-2d7afc89c645 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:15.197133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:15.198340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:15.198626 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:15.198903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] PATH_INFO: `/v3/projects/cf746cf2d9414ff98cc5061606d44a25/users/26a60ef38320483eb6f265d03654582c/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:15.201668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf746cf2d9414ff98cc5061606d44a25, user_id=26a60ef38320483eb6f265d03654582c, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:15.205656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:15.218012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1216/2454] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:15 2022] PUT /identity/v3/projects/cf746cf2d9414ff98cc5061606d44a25/users/26a60ef38320483eb6f265d03654582c/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:15.230320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400fe29-75a2-4801-84ca-d4ed16202359 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:15.231363 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400fe29-75a2-4801-84ca-d4ed16202359 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:15.231660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400fe29-75a2-4801-84ca-d4ed16202359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:15.261167 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-1400fe29-75a2-4801-84ca-d4ed16202359 None None] MFA Rules not processed for user `26a60ef38320483eb6f265d03654582c`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:15.262426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-1400fe29-75a2-4801-84ca-d4ed16202359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:15.347463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1239/2455] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:15.359607 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:15.361389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:15.418666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac86844-f6d6-453a-8fd0-e6d769230524 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:15.423473 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f2749-f700-4f6a-a571-4cc2cd061add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:15.424127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2749-f700-4f6a-a571-4cc2cd061add service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:15.424431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2749-f700-4f6a-a571-4cc2cd061add service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:15.424705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2749-f700-4f6a-a571-4cc2cd061add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:15.434279 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f2749-f700-4f6a-a571-4cc2cd061add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:15.435769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f2749-f700-4f6a-a571-4cc2cd061add service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:15.445979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1217/2456] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:47:15.647542 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400fe29-75a2-4801-84ca-d4ed16202359 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:15.720185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400fe29-75a2-4801-84ca-d4ed16202359 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:15.725014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:15.725897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:15.726174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:15.726576 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] PATH_INFO: `/v3/users/56eca6c1c54d45648b530ef2928ec480` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:15.729067 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56eca6c1c54d45648b530ef2928ec480)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:15.731036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:15.783910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56eca6c1c54d45648b530ef2928ec480'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:15.791557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56eca6c1c54d45648b530ef2928ec480'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:15.800481 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56eca6c1c54d45648b530ef2928ec480'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:15.801728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56eca6c1c54d45648b530ef2928ec480'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:15.816395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56eca6c1c54d45648b530ef2928ec480'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:15.822263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1240/2457] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:15 2022] DELETE /identity/v3/users/56eca6c1c54d45648b530ef2928ec480 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:15.826833 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c01aa-6b9d-41f2-85ef-9e0fad818cce None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:15.827827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c01aa-6b9d-41f2-85ef-9e0fad818cce None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:15.828293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c01aa-6b9d-41f2-85ef-9e0fad818cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:15.846432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-c71c01aa-6b9d-41f2-85ef-9e0fad818cce None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:15.847741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c71c01aa-6b9d-41f2-85ef-9e0fad818cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:15.914893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1218/2458] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:15.925284 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:15.927033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:15.983935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484e18f-f529-4fb7-8698-ceb502f27922 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:15.989307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431ddf3-715a-40ca-9477-217eadeb199c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:15.990308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ddf3-715a-40ca-9477-217eadeb199c service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:15.990600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ddf3-715a-40ca-9477-217eadeb199c service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:15.990883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ddf3-715a-40ca-9477-217eadeb199c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:16.001957 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431ddf3-715a-40ca-9477-217eadeb199c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:16.003462 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431ddf3-715a-40ca-9477-217eadeb199c service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:16.014046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1241/2459] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:16.280964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c01aa-6b9d-41f2-85ef-9e0fad818cce None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:16.282596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c71c01aa-6b9d-41f2-85ef-9e0fad818cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:16.296610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c01aa-6b9d-41f2-85ef-9e0fad818cce None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:16.301516 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:16.302382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:16.302670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:16.302987 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] PATH_INFO: `/v3/projects/bdfd68ef2ca248a7bfa76e2f114ed846` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:16.304285 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfd68ef2ca248a7bfa76e2f114ed846)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:16.306180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:16.354721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfd68ef2ca248a7bfa76e2f114ed846', 'request_id': 'req-9fce3f3c-6156-4081-b918-17f3de9ffbc9'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.361415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfd68ef2ca248a7bfa76e2f114ed846', 'request_id': 'req-9fce3f3c-6156-4081-b918-17f3de9ffbc9'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.366643 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfd68ef2ca248a7bfa76e2f114ed846', 'request_id': 'req-9fce3f3c-6156-4081-b918-17f3de9ffbc9'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.379102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] The token cache is being invalidate because project bdfd68ef2ca248a7bfa76e2f114ed846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:16.379389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.380021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.381543 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1219/2460] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:16 2022] DELETE /identity/v3/projects/bdfd68ef2ca248a7bfa76e2f114ed846 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:16.385669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431ddf3-715a-40ca-9477-217eadeb199c service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:16.395719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431ddf3-715a-40ca-9477-217eadeb199c service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:16.451072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:16.452601 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:16.452883 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:16.453156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] PATH_INFO: `/v3/users/26a60ef38320483eb6f265d03654582c` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:16.454338 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a60ef38320483eb6f265d03654582c)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:16.456746 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:16.504263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a60ef38320483eb6f265d03654582c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.510890 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a60ef38320483eb6f265d03654582c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.520492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a60ef38320483eb6f265d03654582c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.521340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a60ef38320483eb6f265d03654582c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.533413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-07f2b9fa-34bd-4a4b-a032-42a0db91edca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a60ef38320483eb6f265d03654582c'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:16.539492 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1242/2461] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:16 2022] DELETE /identity/v3/users/26a60ef38320483eb6f265d03654582c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:16.866534 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:16.868114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:16.881705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce3f3c-6156-4081-b918-17f3de9ffbc9 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:16.952724 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:16.953599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:16.953882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:16.954154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] PATH_INFO: `/v3/projects/cf746cf2d9414ff98cc5061606d44a25` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:16.955369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf746cf2d9414ff98cc5061606d44a25)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:16.957283 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:17.007782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf746cf2d9414ff98cc5061606d44a25', 'request_id': 'req-46653b77-775f-4cff-9bbe-bb04045a647f'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:17.015603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf746cf2d9414ff98cc5061606d44a25', 'request_id': 'req-46653b77-775f-4cff-9bbe-bb04045a647f'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:17.021226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf746cf2d9414ff98cc5061606d44a25', 'request_id': 'req-46653b77-775f-4cff-9bbe-bb04045a647f'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:17.033447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] The token cache is being invalidate because project cf746cf2d9414ff98cc5061606d44a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:17.033744 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:17.034394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-46653b77-775f-4cff-9bbe-bb04045a647f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:17.036162 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1220/2462] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:16 2022] DELETE /identity/v3/projects/cf746cf2d9414ff98cc5061606d44a25 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:17.040817 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a344ec1-1282-4555-9f18-34a969f5ba6e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.041106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a344ec1-1282-4555-9f18-34a969f5ba6e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.041383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a344ec1-1282-4555-9f18-34a969f5ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.059934 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3a344ec1-1282-4555-9f18-34a969f5ba6e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:17.061218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3a344ec1-1282-4555-9f18-34a969f5ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:17.122134 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1243/2463] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:17.132143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3e291-cb4a-4767-a5d3-309f14496dea None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.132442 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3e291-cb4a-4767-a5d3-309f14496dea None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.132794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3e291-cb4a-4767-a5d3-309f14496dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.150810 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d6e3e291-cb4a-4767-a5d3-309f14496dea None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:17.152216 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d6e3e291-cb4a-4767-a5d3-309f14496dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:17.160552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1221/2464] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:17.164766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a344ec1-1282-4555-9f18-34a969f5ba6e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:17.175223 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a344ec1-1282-4555-9f18-34a969f5ba6e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:17.180337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:17.181008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.181291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.181581 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.182312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:17.182644 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:17.184266 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:17.195973 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1244/2465] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:17.200384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3e291-cb4a-4767-a5d3-309f14496dea None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:17.209513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3e291-cb4a-4767-a5d3-309f14496dea None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:17.214138 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce375a-59a4-4ec2-b378-a98f9f207c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:17.214790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce375a-59a4-4ec2-b378-a98f9f207c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.215107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce375a-59a4-4ec2-b378-a98f9f207c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.215389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce375a-59a4-4ec2-b378-a98f9f207c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.216096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce375a-59a4-4ec2-b378-a98f9f207c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:17.218559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce375a-59a4-4ec2-b378-a98f9f207c90 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:17.244782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1222/2466] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:17 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:17.249022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:17.258750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c1bb-d8ab-4144-9176-dcaaf784106a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:17.316349 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae94fe-f362-4066-81ea-d7d43cc98b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:17.317033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae94fe-f362-4066-81ea-d7d43cc98b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.317320 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae94fe-f362-4066-81ea-d7d43cc98b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.317597 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae94fe-f362-4066-81ea-d7d43cc98b67 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.318303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae94fe-f362-4066-81ea-d7d43cc98b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:17.320313 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae94fe-f362-4066-81ea-d7d43cc98b67 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:17.338709 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1245/2467] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:17 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:17.343386 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce375a-59a4-4ec2-b378-a98f9f207c90 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:17.354456 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce375a-59a4-4ec2-b378-a98f9f207c90 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:17.360044 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439578d4-ce86-4eb0-a28d-6fe974b1b147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:17.360708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439578d4-ce86-4eb0-a28d-6fe974b1b147 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.360991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439578d4-ce86-4eb0-a28d-6fe974b1b147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.361269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439578d4-ce86-4eb0-a28d-6fe974b1b147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.362067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439578d4-ce86-4eb0-a28d-6fe974b1b147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:17.363808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439578d4-ce86-4eb0-a28d-6fe974b1b147 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:17.375789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1223/2468] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:17.380039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae94fe-f362-4066-81ea-d7d43cc98b67 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:17.389837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae94fe-f362-4066-81ea-d7d43cc98b67 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:17.396039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebd0c7-f54b-4dda-b7a2-b62e06a8384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:17.396704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebd0c7-f54b-4dda-b7a2-b62e06a8384f admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.396993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebd0c7-f54b-4dda-b7a2-b62e06a8384f admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.397291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebd0c7-f54b-4dda-b7a2-b62e06a8384f admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.398668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebd0c7-f54b-4dda-b7a2-b62e06a8384f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:17.400962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebd0c7-f54b-4dda-b7a2-b62e06a8384f admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:17.412065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1246/2469] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:17.416160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439578d4-ce86-4eb0-a28d-6fe974b1b147 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:17.429195 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439578d4-ce86-4eb0-a28d-6fe974b1b147 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:17.434102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:17.435050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.435379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.435661 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] PATH_INFO: `/v3/projects/0e004a7ea9ef4e289eac33f2451e6661/users/63edf8ac1fce4261a6b495bbbc76520b/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.451316 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e004a7ea9ef4e289eac33f2451e6661, user_id=63edf8ac1fce4261a6b495bbbc76520b, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:17.454066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:17.468082 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1224/2470] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:17 2022] PUT /identity/v3/projects/0e004a7ea9ef4e289eac33f2451e6661/users/63edf8ac1fce4261a6b495bbbc76520b/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:17.473254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179f69-5108-4172-a991-62e2b37ab907 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.473539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179f69-5108-4172-a991-62e2b37ab907 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.473810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179f69-5108-4172-a991-62e2b37ab907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.492970 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-94179f69-5108-4172-a991-62e2b37ab907 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:17.494165 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-94179f69-5108-4172-a991-62e2b37ab907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:17.553407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1247/2471] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:17.563852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:17.565572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:17.624959 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13e7-65d7-437c-9abb-a0a14ec09c8e admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:17.629296 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:17.630332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.630604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.630978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.641257 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:17.642623 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:17.652857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1225/2472] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:17.874225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aac9f-e302-4dfb-becf-948698ac8885 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:17.874544 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aac9f-e302-4dfb-becf-948698ac8885 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:17.874802 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aac9f-e302-4dfb-becf-948698ac8885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:17.898009 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-a90aac9f-e302-4dfb-becf-948698ac8885 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:17.899182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a90aac9f-e302-4dfb-becf-948698ac8885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:17.964367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1248/2473] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:47:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:18.010222 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:18.011701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:18.091302 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3786e4-6a8b-46f7-b6b1-8655306dd854 service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:18.097466 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031b860-7f97-4908-b2d7-f88a364e7af9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:18.098270 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b860-7f97-4908-b2d7-f88a364e7af9 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:18.098553 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b860-7f97-4908-b2d7-f88a364e7af9 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:18.098823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b860-7f97-4908-b2d7-f88a364e7af9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:18.109227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031b860-7f97-4908-b2d7-f88a364e7af9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:18.110802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031b860-7f97-4908-b2d7-f88a364e7af9 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:18.119297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1226/2474] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:47:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:47:18.803129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353df44-5ea2-424c-8c96-ed9085fb1110 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:18.803604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353df44-5ea2-424c-8c96-ed9085fb1110 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:18.803743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353df44-5ea2-424c-8c96-ed9085fb1110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:18.823036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b353df44-5ea2-424c-8c96-ed9085fb1110 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:18.824382 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b353df44-5ea2-424c-8c96-ed9085fb1110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:18.832694 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1249/2475] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 16:47:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:18.851217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031b860-7f97-4908-b2d7-f88a364e7af9 service swift] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:18.864559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031b860-7f97-4908-b2d7-f88a364e7af9 service swift] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:18.877582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3c04f-3970-4b41-8afa-9bf1dbd73f01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:18.878907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c04f-3970-4b41-8afa-9bf1dbd73f01 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:18.879460 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c04f-3970-4b41-8afa-9bf1dbd73f01 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:18.880150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3c04f-3970-4b41-8afa-9bf1dbd73f01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:18.891640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3c04f-3970-4b41-8afa-9bf1dbd73f01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:18.895702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3c04f-3970-4b41-8afa-9bf1dbd73f01 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:18.906324 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1227/2476] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:47:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:47:19.051626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2b3d4-2d50-43fc-bd47-8602f45ba5ae None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.052086 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2b3d4-2d50-43fc-bd47-8602f45ba5ae None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.052655 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2b3d4-2d50-43fc-bd47-8602f45ba5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.100342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-91a2b3d4-2d50-43fc-bd47-8602f45ba5ae None None] MFA Rules not processed for user `63edf8ac1fce4261a6b495bbbc76520b`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:19.102111 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-91a2b3d4-2d50-43fc-bd47-8602f45ba5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:19.189274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1250/2477] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:19.194045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3c04f-3970-4b41-8afa-9bf1dbd73f01 service swift] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:19.201878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22095d-ddac-4dda-8c1b-e8e977422127 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.202202 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22095d-ddac-4dda-8c1b-e8e977422127 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.202418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22095d-ddac-4dda-8c1b-e8e977422127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.209114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3c04f-3970-4b41-8afa-9bf1dbd73f01 service swift] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:19.215497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a04ce-01d5-4b1c-afc5-d95d99bdb0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:19.216447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a04ce-01d5-4b1c-afc5-d95d99bdb0ab admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.216941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a04ce-01d5-4b1c-afc5-d95d99bdb0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.217487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a04ce-01d5-4b1c-afc5-d95d99bdb0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.218832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a04ce-01d5-4b1c-afc5-d95d99bdb0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:19.221409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a04ce-01d5-4b1c-afc5-d95d99bdb0ab admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:19.225925 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4c22095d-ddac-4dda-8c1b-e8e977422127 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:19.227778 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4c22095d-ddac-4dda-8c1b-e8e977422127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:19.246269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1251/2478] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:47:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:19.256311 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22095d-ddac-4dda-8c1b-e8e977422127 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:19.267150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1228/2479] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:19 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:19.268840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a04ce-01d5-4b1c-afc5-d95d99bdb0ab admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:19.280295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22095d-ddac-4dda-8c1b-e8e977422127 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:19.355589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a04ce-01d5-4b1c-afc5-d95d99bdb0ab admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:19.362895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07432b-864b-49fc-9a4e-8a7c1be43759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:19.363893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07432b-864b-49fc-9a4e-8a7c1be43759 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.364173 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07432b-864b-49fc-9a4e-8a7c1be43759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.364455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07432b-864b-49fc-9a4e-8a7c1be43759 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.365141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07432b-864b-49fc-9a4e-8a7c1be43759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:19.368357 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07432b-864b-49fc-9a4e-8a7c1be43759 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:19.379275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446c24d-d716-4ff0-89dc-c9eb11cb989f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:19.380309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446c24d-d716-4ff0-89dc-c9eb11cb989f service swift] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.380676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446c24d-d716-4ff0-89dc-c9eb11cb989f service swift] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.381081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446c24d-d716-4ff0-89dc-c9eb11cb989f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.398225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1229/2480] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:19 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:47:19.402700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07432b-864b-49fc-9a4e-8a7c1be43759 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:19.413274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07432b-864b-49fc-9a4e-8a7c1be43759 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:19.419680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485ba95-4a99-4cad-9ce1-3445b4536bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:19.420578 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485ba95-4a99-4cad-9ce1-3445b4536bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.421536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485ba95-4a99-4cad-9ce1-3445b4536bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.421981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485ba95-4a99-4cad-9ce1-3445b4536bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.423036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485ba95-4a99-4cad-9ce1-3445b4536bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:19.425107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485ba95-4a99-4cad-9ce1-3445b4536bf3 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:19.436389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1230/2481] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:19.440513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485ba95-4a99-4cad-9ce1-3445b4536bf3 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:19.453956 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446c24d-d716-4ff0-89dc-c9eb11cb989f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:19.454204 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485ba95-4a99-4cad-9ce1-3445b4536bf3 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:19.456412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446c24d-d716-4ff0-89dc-c9eb11cb989f service swift] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:19.460228 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44dfca-cbc2-4ddc-9e04-8cb27630f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:19.461636 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44dfca-cbc2-4ddc-9e04-8cb27630f3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.461944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44dfca-cbc2-4ddc-9e04-8cb27630f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.462234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44dfca-cbc2-4ddc-9e04-8cb27630f3dd admin admin] PATH_INFO: `/v3/projects/a8314d4f15e2480aabc52b22f5c399aa/users/91d4ae9abfd748e6987687c1ddfcea0e/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.465337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1252/2482] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:47:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 16:47:19.481842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44dfca-cbc2-4ddc-9e04-8cb27630f3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8314d4f15e2480aabc52b22f5c399aa, user_id=91d4ae9abfd748e6987687c1ddfcea0e, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:19.485741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44dfca-cbc2-4ddc-9e04-8cb27630f3dd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:19.503958 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1231/2483] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:19 2022] PUT /identity/v3/projects/a8314d4f15e2480aabc52b22f5c399aa/users/91d4ae9abfd748e6987687c1ddfcea0e/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:47:19.508485 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446c24d-d716-4ff0-89dc-c9eb11cb989f service swift] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:19.520630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446c24d-d716-4ff0-89dc-c9eb11cb989f service swift] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:19.579625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fa848-978e-4a08-969d-93ea72460f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:19.580309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa848-978e-4a08-969d-93ea72460f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.583233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa848-978e-4a08-969d-93ea72460f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.583525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa848-978e-4a08-969d-93ea72460f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.584289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fa848-978e-4a08-969d-93ea72460f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:19.585905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fa848-978e-4a08-969d-93ea72460f4c admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:19.597000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1253/2484] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:19.600977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44dfca-cbc2-4ddc-9e04-8cb27630f3dd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:19.611365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44dfca-cbc2-4ddc-9e04-8cb27630f3dd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:19.618319 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6945-f73e-432b-b714-6822d306a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:19.619245 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6945-f73e-432b-b714-6822d306a4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.619575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6945-f73e-432b-b714-6822d306a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.619790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6945-f73e-432b-b714-6822d306a4f2 admin admin] PATH_INFO: `/v3/projects/a8314d4f15e2480aabc52b22f5c399aa/users/91d4ae9abfd748e6987687c1ddfcea0e/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.621801 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba6945-f73e-432b-b714-6822d306a4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8314d4f15e2480aabc52b22f5c399aa, user_id=91d4ae9abfd748e6987687c1ddfcea0e, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:19.625207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba6945-f73e-432b-b714-6822d306a4f2 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:19.636086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1232/2485] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:19 2022] PUT /identity/v3/projects/a8314d4f15e2480aabc52b22f5c399aa/users/91d4ae9abfd748e6987687c1ddfcea0e/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:19.884719 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004832c-3d6f-4bd8-ad40-c2872791a021 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:19.885594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004832c-3d6f-4bd8-ad40-c2872791a021 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:19.886402 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004832c-3d6f-4bd8-ad40-c2872791a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:19.924931 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4004832c-3d6f-4bd8-ad40-c2872791a021 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:19.926677 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4004832c-3d6f-4bd8-ad40-c2872791a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:19.982857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1254/2486] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 16:47:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:19.996227 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6945-f73e-432b-b714-6822d306a4f2 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:20.085624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6945-f73e-432b-b714-6822d306a4f2 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:20.085624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:20.085624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:20.085923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:20.086127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:20.096079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:20.097690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:20.106687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1233/2487] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:47:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:47:20.360557 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18c3d5-b92d-417d-9264-42880f7422fc None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:20.360851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18c3d5-b92d-417d-9264-42880f7422fc None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:20.361141 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18c3d5-b92d-417d-9264-42880f7422fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:20.391495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-4e18c3d5-b92d-417d-9264-42880f7422fc None None] MFA Rules not processed for user `91d4ae9abfd748e6987687c1ddfcea0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:20.392691 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4e18c3d5-b92d-417d-9264-42880f7422fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:20.463858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1255/2488] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:20.476377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:20.477836 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:20.559713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454fda5-2788-4854-b062-19a5e27ac3c2 service swift] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:20.569497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac72e-c485-4763-a885-40f9229f86c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:20.570481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac72e-c485-4763-a885-40f9229f86c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:20.571057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac72e-c485-4763-a885-40f9229f86c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:20.571611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcac72e-c485-4763-a885-40f9229f86c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:20.646013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcac72e-c485-4763-a885-40f9229f86c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:20.647609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcac72e-c485-4763-a885-40f9229f86c5 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:20.658264 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1234/2489] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:22.009407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbacbc0-fae2-4e85-9b87-9302064e14fd None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:22.009903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbacbc0-fae2-4e85-9b87-9302064e14fd None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:22.010020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbacbc0-fae2-4e85-9b87-9302064e14fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:22.029686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5bbacbc0-fae2-4e85-9b87-9302064e14fd None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:22.031769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5bbacbc0-fae2-4e85-9b87-9302064e14fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:22.039045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1256/2490] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:47:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:22.051660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac72e-c485-4763-a885-40f9229f86c5 service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:22.063657 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcac72e-c485-4763-a885-40f9229f86c5 service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:22.068778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11763e-8821-408e-8100-9063167db86c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:22.069411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11763e-8821-408e-8100-9063167db86c service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:22.069692 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11763e-8821-408e-8100-9063167db86c service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:22.069966 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11763e-8821-408e-8100-9063167db86c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:22.078605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11763e-8821-408e-8100-9063167db86c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:22.080215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11763e-8821-408e-8100-9063167db86c service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:22.088068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1235/2491] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:47:23.153545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbacbc0-fae2-4e85-9b87-9302064e14fd None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:23.156687 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5bbacbc0-fae2-4e85-9b87-9302064e14fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:23.184860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbacbc0-fae2-4e85-9b87-9302064e14fd None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:23.190277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc77a5-93e6-4581-beee-a95f975fdb2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:23.191175 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc77a5-93e6-4581-beee-a95f975fdb2d service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:23.191528 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc77a5-93e6-4581-beee-a95f975fdb2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:23.192028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc77a5-93e6-4581-beee-a95f975fdb2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:23.207995 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc77a5-93e6-4581-beee-a95f975fdb2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:23.209571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc77a5-93e6-4581-beee-a95f975fdb2d service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:23.222814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1257/2492] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:23.259860 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770dc42-a437-41f0-a44e-8f1071a63f07 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:23.260814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770dc42-a437-41f0-a44e-8f1071a63f07 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:23.261398 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770dc42-a437-41f0-a44e-8f1071a63f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:23.286147 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-6770dc42-a437-41f0-a44e-8f1071a63f07 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:23.287882 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6770dc42-a437-41f0-a44e-8f1071a63f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:23.297115 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1236/2493] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:47:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:23.313652 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc77a5-93e6-4581-beee-a95f975fdb2d service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:23.331750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc77a5-93e6-4581-beee-a95f975fdb2d service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:23.349372 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a864ef-f619-4e65-aa1a-7e6c64a9d50d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:23.349762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a864ef-f619-4e65-aa1a-7e6c64a9d50d service swift] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:23.350022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a864ef-f619-4e65-aa1a-7e6c64a9d50d service swift] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:23.350306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a864ef-f619-4e65-aa1a-7e6c64a9d50d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:23.368366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a864ef-f619-4e65-aa1a-7e6c64a9d50d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:23.371099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a864ef-f619-4e65-aa1a-7e6c64a9d50d service swift] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:23.416545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1258/2494] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:47:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:47:24.492824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770dc42-a437-41f0-a44e-8f1071a63f07 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:24.494242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6770dc42-a437-41f0-a44e-8f1071a63f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:24.644301 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770dc42-a437-41f0-a44e-8f1071a63f07 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:24.667827 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:24.668754 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:24.669039 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:24.669320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] PATH_INFO: `/v3/users/901a5e4c69f044bda6e36690489f1c29` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:24.673893 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901a5e4c69f044bda6e36690489f1c29)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:24.676137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:24.859705 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901a5e4c69f044bda6e36690489f1c29'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:24.877096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901a5e4c69f044bda6e36690489f1c29'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:24.903438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901a5e4c69f044bda6e36690489f1c29'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:24.904092 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901a5e4c69f044bda6e36690489f1c29'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:24.938425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901a5e4c69f044bda6e36690489f1c29'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:24.946610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1237/2495] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:24 2022] DELETE /identity/v3/users/901a5e4c69f044bda6e36690489f1c29 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:24.951577 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc972fe-b1cc-43e5-8630-3ca4943810df None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:24.953212 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc972fe-b1cc-43e5-8630-3ca4943810df None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:24.953825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc972fe-b1cc-43e5-8630-3ca4943810df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:25.007707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fdc972fe-b1cc-43e5-8630-3ca4943810df None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:25.011833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fdc972fe-b1cc-43e5-8630-3ca4943810df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:25.273858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1259/2496] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:25.296734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:25.307737 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:25.446591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83b662-621a-4157-b86a-b543ab8750f8 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:25.469998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1a4c1-e771-4e96-9b04-339c1c60065c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:25.469998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a4c1-e771-4e96-9b04-339c1c60065c service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:25.469998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a4c1-e771-4e96-9b04-339c1c60065c service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:25.469998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1a4c1-e771-4e96-9b04-339c1c60065c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:25.491332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1a4c1-e771-4e96-9b04-339c1c60065c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:25.492901 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1a4c1-e771-4e96-9b04-339c1c60065c service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:25.518038 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1238/2497] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:25.945463 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc972fe-b1cc-43e5-8630-3ca4943810df None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:25.948109 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fdc972fe-b1cc-43e5-8630-3ca4943810df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:25.999945 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc972fe-b1cc-43e5-8630-3ca4943810df None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:26.008208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:26.009800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:26.010286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:26.011917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] PATH_INFO: `/v3/projects/acea6fb6fa724b1eac5123649d711528` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:26.014355 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acea6fb6fa724b1eac5123649d711528)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:26.017480 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:26.117515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acea6fb6fa724b1eac5123649d711528', 'request_id': 'req-4666683c-4f1c-4a65-8e7f-b4051b103334'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:26.136877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acea6fb6fa724b1eac5123649d711528', 'request_id': 'req-4666683c-4f1c-4a65-8e7f-b4051b103334'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:26.148276 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acea6fb6fa724b1eac5123649d711528', 'request_id': 'req-4666683c-4f1c-4a65-8e7f-b4051b103334'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:26.175565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] The token cache is being invalidate because project acea6fb6fa724b1eac5123649d711528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:26.176246 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:26.177958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-4666683c-4f1c-4a65-8e7f-b4051b103334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:26.182004 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1260/2498] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:25 2022] DELETE /identity/v3/projects/acea6fb6fa724b1eac5123649d711528 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:26.188221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4580ba-4e04-41e1-ada6-4b1d4574e515 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:26.188624 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4580ba-4e04-41e1-ada6-4b1d4574e515 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:26.189008 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4580ba-4e04-41e1-ada6-4b1d4574e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:26.281929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5b4580ba-4e04-41e1-ada6-4b1d4574e515 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:26.283633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5b4580ba-4e04-41e1-ada6-4b1d4574e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:26.409720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1239/2499] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:26.410288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e697-4112-4833-b31a-3009fdd3f3ea None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:26.410629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e697-4112-4833-b31a-3009fdd3f3ea None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:26.411515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e697-4112-4833-b31a-3009fdd3f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:26.530798 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-c9d7e697-4112-4833-b31a-3009fdd3f3ea None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:26.533410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-c9d7e697-4112-4833-b31a-3009fdd3f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:26.591273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1261/2500] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:26.597930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4580ba-4e04-41e1-ada6-4b1d4574e515 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:26.613824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4580ba-4e04-41e1-ada6-4b1d4574e515 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:26.636923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:26.637823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:26.637941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:26.638215 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:26.638981 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:26.639918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:26.641540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:26.674762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1240/2501] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:26.675079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7e697-4112-4833-b31a-3009fdd3f3ea None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:26.685840 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7e697-4112-4833-b31a-3009fdd3f3ea None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:26.691232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8ef23-658a-44dc-99da-7b974e1ad10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:26.691913 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ef23-658a-44dc-99da-7b974e1ad10e admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:26.692356 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ef23-658a-44dc-99da-7b974e1ad10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:26.692641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ef23-658a-44dc-99da-7b974e1ad10e admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:26.693391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8ef23-658a-44dc-99da-7b974e1ad10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:26.697599 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8ef23-658a-44dc-99da-7b974e1ad10e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:26.748399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1262/2502] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:26 2022] POST /identity/v3/projects => generated 397 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:47:26.752489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:26.762936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442330b3-325d-4313-9bfe-7e2395ef2f7d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:26.867599 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93660e-87e3-43f0-bdbb-7485152950cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:26.868290 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93660e-87e3-43f0-bdbb-7485152950cc admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:26.868914 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93660e-87e3-43f0-bdbb-7485152950cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:26.869323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93660e-87e3-43f0-bdbb-7485152950cc admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:26.870190 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93660e-87e3-43f0-bdbb-7485152950cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:26.874476 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93660e-87e3-43f0-bdbb-7485152950cc admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:26.927026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1241/2503] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:26 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:26.928990 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8ef23-658a-44dc-99da-7b974e1ad10e admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:26.946837 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8ef23-658a-44dc-99da-7b974e1ad10e admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:26.955053 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d372b0-40a2-4166-a46f-70da1908fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:26.956620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d372b0-40a2-4166-a46f-70da1908fc02 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:26.957177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d372b0-40a2-4166-a46f-70da1908fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:26.957629 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d372b0-40a2-4166-a46f-70da1908fc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:26.959247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d372b0-40a2-4166-a46f-70da1908fc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:26.961894 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d372b0-40a2-4166-a46f-70da1908fc02 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:26.998275 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1263/2504] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:27.004083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93660e-87e3-43f0-bdbb-7485152950cc admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:27.019853 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93660e-87e3-43f0-bdbb-7485152950cc admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:27.037598 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc166f-2615-4ece-84d5-94760036a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:27.038702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc166f-2615-4ece-84d5-94760036a2af admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:27.039297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc166f-2615-4ece-84d5-94760036a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:27.039828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc166f-2615-4ece-84d5-94760036a2af admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:27.040782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc166f-2615-4ece-84d5-94760036a2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:27.042628 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc166f-2615-4ece-84d5-94760036a2af admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:27.070870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1242/2505] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:47:27.078426 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d372b0-40a2-4166-a46f-70da1908fc02 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:27.094686 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d372b0-40a2-4166-a46f-70da1908fc02 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:27.102805 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:27.103873 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:27.104146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:27.104437 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] PATH_INFO: `/v3/projects/c9002cc03c2f457fa78b0ca53926c7d4/users/17759953358c4cedb48a9e225b53e4d6/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:27.127885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9002cc03c2f457fa78b0ca53926c7d4, user_id=17759953358c4cedb48a9e225b53e4d6, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:27.135410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:27.165219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1264/2506] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:27 2022] PUT /identity/v3/projects/c9002cc03c2f457fa78b0ca53926c7d4/users/17759953358c4cedb48a9e225b53e4d6/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:27.166806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d08c0-b326-4537-918c-8b3f2db587a3 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:27.167557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d08c0-b326-4537-918c-8b3f2db587a3 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:27.167945 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d08c0-b326-4537-918c-8b3f2db587a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:27.249408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-e86d08c0-b326-4537-918c-8b3f2db587a3 None None] MFA Rules not processed for user `17759953358c4cedb48a9e225b53e4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:27.251267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e86d08c0-b326-4537-918c-8b3f2db587a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:27.481275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1243/2507] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:27.496071 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:27.498684 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:27.658800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1e26f-47bf-4314-bdda-c29220bb7816 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:27.662722 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c57e3-df60-4b9e-afa0-21a69e505249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:27.663493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c57e3-df60-4b9e-afa0-21a69e505249 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:27.663971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c57e3-df60-4b9e-afa0-21a69e505249 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:27.664886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c57e3-df60-4b9e-afa0-21a69e505249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:27.675585 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c57e3-df60-4b9e-afa0-21a69e505249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:27.678839 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c57e3-df60-4b9e-afa0-21a69e505249 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:27.694598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1265/2508] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:31.115054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd50b4-462d-464d-8941-cdf0e19865e8 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:31.116044 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd50b4-462d-464d-8941-cdf0e19865e8 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:31.116334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd50b4-462d-464d-8941-cdf0e19865e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:31.141700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3ecd50b4-462d-464d-8941-cdf0e19865e8 None None] MFA Rules not processed for user `1bc2420288964c389f6529d9ede09bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:31.143376 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3ecd50b4-462d-464d-8941-cdf0e19865e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:31.212467 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1244/2509] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:37.812063 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c57e3-df60-4b9e-afa0-21a69e505249 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:38.084070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c57e3-df60-4b9e-afa0-21a69e505249 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:38.089899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:38.091007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:38.091438 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:38.091942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] PATH_INFO: `/v3/users/17759953358c4cedb48a9e225b53e4d6` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:38.093842 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17759953358c4cedb48a9e225b53e4d6)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:38.097282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:38.171033 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17759953358c4cedb48a9e225b53e4d6'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:38.179834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17759953358c4cedb48a9e225b53e4d6'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:38.193858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17759953358c4cedb48a9e225b53e4d6'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:38.194669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17759953358c4cedb48a9e225b53e4d6'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:38.214220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17759953358c4cedb48a9e225b53e4d6'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:38.225395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1266/2510] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:37 2022] DELETE /identity/v3/users/17759953358c4cedb48a9e225b53e4d6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:38.230185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35b4c-6ec8-408c-ad1b-e1851cd8439c None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:38.230734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35b4c-6ec8-408c-ad1b-e1851cd8439c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:38.230734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a35b4c-6ec8-408c-ad1b-e1851cd8439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:38.254673 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-f0a35b4c-6ec8-408c-ad1b-e1851cd8439c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:38.256702 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f0a35b4c-6ec8-408c-ad1b-e1851cd8439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:38.344658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1245/2511] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:38.370757 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:38.372994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:38.471891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047680e7-76b0-4cbf-a0f5-277c5b6ba713 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:38.478305 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:38.479147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:38.479587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:38.479888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:38.505005 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:38.506852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:38.560109 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1267/2512] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:38.756976 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942cc8-e003-4587-9d7f-f2f211819430 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:38.757741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942cc8-e003-4587-9d7f-f2f211819430 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:38.758358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942cc8-e003-4587-9d7f-f2f211819430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:38.828255 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-0b942cc8-e003-4587-9d7f-f2f211819430 None None] MFA Rules not processed for user `de5e76d5385f44fab03527751a478f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:38.829615 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-0b942cc8-e003-4587-9d7f-f2f211819430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:39.016749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1246/2513] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:40.060068 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:40.062887 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:40.096560 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac0429-b738-428d-8370-ae8002a37a98 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:40.108733 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:40.113281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:40.113792 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:40.114194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] PATH_INFO: `/v3/projects/c9002cc03c2f457fa78b0ca53926c7d4` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:40.115723 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9002cc03c2f457fa78b0ca53926c7d4)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:40.121451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:40.248100 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9002cc03c2f457fa78b0ca53926c7d4', 'request_id': 'req-20cc0145-a7a1-4ffe-ac27-801a93ba684b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:40.270635 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9002cc03c2f457fa78b0ca53926c7d4', 'request_id': 'req-20cc0145-a7a1-4ffe-ac27-801a93ba684b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:40.289045 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9002cc03c2f457fa78b0ca53926c7d4', 'request_id': 'req-20cc0145-a7a1-4ffe-ac27-801a93ba684b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:40.318856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] The token cache is being invalidate because project c9002cc03c2f457fa78b0ca53926c7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:40.321487 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:40.323208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-20cc0145-a7a1-4ffe-ac27-801a93ba684b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:40.327422 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1268/2514] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:40 2022] DELETE /identity/v3/projects/c9002cc03c2f457fa78b0ca53926c7d4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:44.318795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b942cc8-e003-4587-9d7f-f2f211819430 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:44.320388 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-0b942cc8-e003-4587-9d7f-f2f211819430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:44.362579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b942cc8-e003-4587-9d7f-f2f211819430 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:44.506825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:44.508678 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:44.509420 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:44.509862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa99e-0143-459f-b5cc-75b9e190d76b None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:44.510335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa99e-0143-459f-b5cc-75b9e190d76b None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:44.510419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa99e-0143-459f-b5cc-75b9e190d76b None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:44.510782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] PATH_INFO: `/v3/users/63edf8ac1fce4261a6b495bbbc76520b` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:44.512095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1269/2515] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:47:44.512610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63edf8ac1fce4261a6b495bbbc76520b)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:44.515265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:44.518815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50e6b-a046-4140-87df-d75a577e7c4a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:44.519551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50e6b-a046-4140-87df-d75a577e7c4a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:44.520184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50e6b-a046-4140-87df-d75a577e7c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:44.630848 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63edf8ac1fce4261a6b495bbbc76520b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:44.641717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-9ae50e6b-a046-4140-87df-d75a577e7c4a None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:44.643491 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9ae50e6b-a046-4140-87df-d75a577e7c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:44.644930 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63edf8ac1fce4261a6b495bbbc76520b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:44.660576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63edf8ac1fce4261a6b495bbbc76520b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:44.661727 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63edf8ac1fce4261a6b495bbbc76520b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:44.691811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63edf8ac1fce4261a6b495bbbc76520b'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:44.712440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1247/2516] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:44 2022] DELETE /identity/v3/users/63edf8ac1fce4261a6b495bbbc76520b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:44.810412 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1270/2517] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:47:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:44.830205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:44.836379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:45.024726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903130d-3643-4c93-91f5-d28c1db81491 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:45.053989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac366a-9352-47e8-82be-62d8d30b0742 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039df81163264994a86fe2e98bb96983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:45.054806 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac366a-9352-47e8-82be-62d8d30b0742 service glance] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:45.060873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac366a-9352-47e8-82be-62d8d30b0742 service glance] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:45.067332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac366a-9352-47e8-82be-62d8d30b0742 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:45.152676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50e6b-a046-4140-87df-d75a577e7c4a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:45.155233 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9ae50e6b-a046-4140-87df-d75a577e7c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:45.218994 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50e6b-a046-4140-87df-d75a577e7c4a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:45.375538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac366a-9352-47e8-82be-62d8d30b0742 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:45.380726 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac366a-9352-47e8-82be-62d8d30b0742 service glance] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:45.406007 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:45.407334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:45.407895 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:45.408359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] PATH_INFO: `/v3/projects/0e004a7ea9ef4e289eac33f2451e6661` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:45.409753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e004a7ea9ef4e289eac33f2451e6661)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:45.415451 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:45.433323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1248/2518] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:45.528743 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e004a7ea9ef4e289eac33f2451e6661', 'request_id': 'req-0d110ae0-02ac-4226-a368-ecdc74a8f708'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.549374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e004a7ea9ef4e289eac33f2451e6661', 'request_id': 'req-0d110ae0-02ac-4226-a368-ecdc74a8f708'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.557598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e004a7ea9ef4e289eac33f2451e6661', 'request_id': 'req-0d110ae0-02ac-4226-a368-ecdc74a8f708'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.578910 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] The token cache is being invalidate because project 0e004a7ea9ef4e289eac33f2451e6661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:45.579269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.581070 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-0d110ae0-02ac-4226-a368-ecdc74a8f708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.585989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1271/2519] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:45 2022] DELETE /identity/v3/projects/0e004a7ea9ef4e289eac33f2451e6661 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:45.588337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac366a-9352-47e8-82be-62d8d30b0742 service glance] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:45.594740 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729642ac-5514-4777-912e-2b166473f36d None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:45.595877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729642ac-5514-4777-912e-2b166473f36d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:45.596414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729642ac-5514-4777-912e-2b166473f36d None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:45.598195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1272/2520] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:47:45.605826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc201e1-c63e-47c3-b72b-7952e719252d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:45.606244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc201e1-c63e-47c3-b72b-7952e719252d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:45.606641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc201e1-c63e-47c3-b72b-7952e719252d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:45.607321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac366a-9352-47e8-82be-62d8d30b0742 service glance] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:45.630274 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-acc201e1-c63e-47c3-b72b-7952e719252d None None] MFA Rules not processed for user `05b1227b7f36498e8c1f1e27fa0ccb46`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:45.632703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-acc201e1-c63e-47c3-b72b-7952e719252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:45.777640 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:45.778738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:45.779186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:45.779540 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] PATH_INFO: `/v3/users/91d4ae9abfd748e6987687c1ddfcea0e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:45.784307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1273/2521] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:47:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:45.791479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d4ae9abfd748e6987687c1ddfcea0e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:45.795241 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:45.802030 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc201e1-c63e-47c3-b72b-7952e719252d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:45.803739 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-acc201e1-c63e-47c3-b72b-7952e719252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:45.827747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc201e1-c63e-47c3-b72b-7952e719252d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:45.842646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29073cac-a7fe-4cb4-815e-a31425f0a766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:45.843452 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29073cac-a7fe-4cb4-815e-a31425f0a766 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:45.843799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29073cac-a7fe-4cb4-815e-a31425f0a766 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:45.844149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29073cac-a7fe-4cb4-815e-a31425f0a766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:45.868690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29073cac-a7fe-4cb4-815e-a31425f0a766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:45.870427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29073cac-a7fe-4cb4-815e-a31425f0a766 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:45.876332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d4ae9abfd748e6987687c1ddfcea0e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.885088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d4ae9abfd748e6987687c1ddfcea0e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.898698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1274/2522] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:47:45.913519 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d4ae9abfd748e6987687c1ddfcea0e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.914542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d4ae9abfd748e6987687c1ddfcea0e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:45.985949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6e23e5b5-a98c-4cf2-a5cd-2be32b3464cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d4ae9abfd748e6987687c1ddfcea0e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:46.001458 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1249/2523] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:47:45 2022] DELETE /identity/v3/users/91d4ae9abfd748e6987687c1ddfcea0e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:46.173693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c7924-18dd-4982-92f4-6a8783d5b4cc None None] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:46.174287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c7924-18dd-4982-92f4-6a8783d5b4cc None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:46.174759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c7924-18dd-4982-92f4-6a8783d5b4cc None None] PATH_INFO: `/` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:46.176588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1275/2524] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 16:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:47:46.196777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78725-7457-4dba-ab0e-a0b30f3ed584 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:46.197161 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78725-7457-4dba-ab0e-a0b30f3ed584 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:46.197536 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78725-7457-4dba-ab0e-a0b30f3ed584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:46.256198 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-f1d78725-7457-4dba-ab0e-a0b30f3ed584 None None] MFA Rules not processed for user `3d11d338bf2c4521bdfddc5d5c8da899`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:46.257447 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f1d78725-7457-4dba-ab0e-a0b30f3ed584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:46.405734 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1250/2525] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 16:47:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:46.434643 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c7924-18dd-4982-92f4-6a8783d5b4cc None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:46.437189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-bd4c7924-18dd-4982-92f4-6a8783d5b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:46.573565 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c7924-18dd-4982-92f4-6a8783d5b4cc None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:46.577503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1badc-c907-4330-9dff-d9ce9e14a6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:46.578234 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1badc-c907-4330-9dff-d9ce9e14a6ec service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:46.578738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1badc-c907-4330-9dff-d9ce9e14a6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:46.579122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1badc-c907-4330-9dff-d9ce9e14a6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:46.591260 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1badc-c907-4330-9dff-d9ce9e14a6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:46.594120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1badc-c907-4330-9dff-d9ce9e14a6ec service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:46.623762 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1276/2526] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:47.344708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78725-7457-4dba-ab0e-a0b30f3ed584 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:47.346263 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f1d78725-7457-4dba-ab0e-a0b30f3ed584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:47.496309 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78725-7457-4dba-ab0e-a0b30f3ed584 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:47.515881 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:47.517146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:47.517730 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:47.518165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] PATH_INFO: `/v3/projects/a8314d4f15e2480aabc52b22f5c399aa` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:47.520205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8314d4f15e2480aabc52b22f5c399aa)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:47.522278 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:47.659176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8314d4f15e2480aabc52b22f5c399aa', 'request_id': 'req-f82c9571-a6e2-4b99-9026-bc70dd029313'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:47.674066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8314d4f15e2480aabc52b22f5c399aa', 'request_id': 'req-f82c9571-a6e2-4b99-9026-bc70dd029313'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:47.696373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8314d4f15e2480aabc52b22f5c399aa', 'request_id': 'req-f82c9571-a6e2-4b99-9026-bc70dd029313'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:47.733645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] The token cache is being invalidate because project a8314d4f15e2480aabc52b22f5c399aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:47:47.733944 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:47.734842 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-f82c9571-a6e2-4b99-9026-bc70dd029313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:47:47.737614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1251/2527] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:47:47 2022] DELETE /identity/v3/projects/a8314d4f15e2480aabc52b22f5c399aa => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:47.743265 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fb24-e39d-427e-b7c1-eaf0b745ad2d None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:47.743726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fb24-e39d-427e-b7c1-eaf0b745ad2d None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:47.743836 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fb24-e39d-427e-b7c1-eaf0b745ad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:47.764858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3262fb24-e39d-427e-b7c1-eaf0b745ad2d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:47.766400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3262fb24-e39d-427e-b7c1-eaf0b745ad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:47.874129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1277/2528] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:47.882802 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee45ad-1279-4a76-ade0-2afa7dff406b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:47.883200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee45ad-1279-4a76-ade0-2afa7dff406b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:47.885139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee45ad-1279-4a76-ade0-2afa7dff406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:47.908942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-23ee45ad-1279-4a76-ade0-2afa7dff406b None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:47.909962 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-23ee45ad-1279-4a76-ade0-2afa7dff406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:47.933110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1252/2529] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:47.936384 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262fb24-e39d-427e-b7c1-eaf0b745ad2d None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:47.948225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262fb24-e39d-427e-b7c1-eaf0b745ad2d None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:47.954316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:47.955395 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:47.956028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:47.956535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:47.957512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:47.958011 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:47.960155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:47.984352 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1278/2530] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:47.988567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee45ad-1279-4a76-ade0-2afa7dff406b None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:48.000056 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee45ad-1279-4a76-ade0-2afa7dff406b None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:48.022093 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c52982-c2b9-4e38-8e02-35bbf97dda87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:48.024009 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c52982-c2b9-4e38-8e02-35bbf97dda87 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:48.024493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c52982-c2b9-4e38-8e02-35bbf97dda87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:48.025165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c52982-c2b9-4e38-8e02-35bbf97dda87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:48.026030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c52982-c2b9-4e38-8e02-35bbf97dda87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:48.028625 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c52982-c2b9-4e38-8e02-35bbf97dda87 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:48.076642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:48.076798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1253/2531] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:47:47 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:48.090545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d783e1-69a7-4a12-a03b-07334cdb7002 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:48.190541 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01007b-4a96-4bc6-96bc-be68a67aa0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:48.191364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01007b-4a96-4bc6-96bc-be68a67aa0ea admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:48.191759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01007b-4a96-4bc6-96bc-be68a67aa0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:48.192105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01007b-4a96-4bc6-96bc-be68a67aa0ea admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:48.192866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01007b-4a96-4bc6-96bc-be68a67aa0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:48.195008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01007b-4a96-4bc6-96bc-be68a67aa0ea admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:48.224259 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1279/2532] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:47:48 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:48.228106 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c52982-c2b9-4e38-8e02-35bbf97dda87 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:48.246954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c52982-c2b9-4e38-8e02-35bbf97dda87 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:48.261483 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d8c3-2b38-4cb2-8bee-52fa50743253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:48.262378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d8c3-2b38-4cb2-8bee-52fa50743253 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:48.263004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d8c3-2b38-4cb2-8bee-52fa50743253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:48.264006 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d8c3-2b38-4cb2-8bee-52fa50743253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:48.265528 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606d8c3-2b38-4cb2-8bee-52fa50743253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:48.296378 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606d8c3-2b38-4cb2-8bee-52fa50743253 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:48.333824 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1254/2533] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:48.339205 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01007b-4a96-4bc6-96bc-be68a67aa0ea admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:48.360905 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01007b-4a96-4bc6-96bc-be68a67aa0ea admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:48.385476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973da1d-30e5-4748-839c-1f5baaaaebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:48.386218 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973da1d-30e5-4748-839c-1f5baaaaebd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:48.386499 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973da1d-30e5-4748-839c-1f5baaaaebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:48.386769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973da1d-30e5-4748-839c-1f5baaaaebd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:48.387540 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973da1d-30e5-4748-839c-1f5baaaaebd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:48.393028 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973da1d-30e5-4748-839c-1f5baaaaebd5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:48.414458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1280/2534] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:47:48.419180 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d8c3-2b38-4cb2-8bee-52fa50743253 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:48.433851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d8c3-2b38-4cb2-8bee-52fa50743253 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:48.439703 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:48.441074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:48.442219 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:48.442720 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] PATH_INFO: `/v3/projects/772edda19c464d5c91366a7b6a9cc424/users/437a2c1b2a04411abf858202c311dc1c/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:48.486189 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=772edda19c464d5c91366a7b6a9cc424, user_id=437a2c1b2a04411abf858202c311dc1c, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:48.490277 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:48.510083 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1255/2535] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:47:48 2022] PUT /identity/v3/projects/772edda19c464d5c91366a7b6a9cc424/users/437a2c1b2a04411abf858202c311dc1c/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:48.521571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec07e18-b30f-4cbc-94c0-240fb955c94a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:48.522095 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec07e18-b30f-4cbc-94c0-240fb955c94a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:48.522444 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec07e18-b30f-4cbc-94c0-240fb955c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:48.575567 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-cec07e18-b30f-4cbc-94c0-240fb955c94a None None] MFA Rules not processed for user `437a2c1b2a04411abf858202c311dc1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:48.583515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-cec07e18-b30f-4cbc-94c0-240fb955c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:48.725948 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1281/2536] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:47:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:56.029928 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:56.032185 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:56.111736 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47923b-433a-4d31-88b4-8ef21af21cda admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:56.115299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039df81163264994a86fe2e98bb96983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:56.115940 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:56.116217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:56.116487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:56.124513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:56.125918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:56.134477 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1256/2537] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:47:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:56.498292 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2627b-f991-4498-b391-7c64e8e1402c None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:56.498823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2627b-f991-4498-b391-7c64e8e1402c None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:56.498823 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2627b-f991-4498-b391-7c64e8e1402c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:56.550020 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-44c2627b-f991-4498-b391-7c64e8e1402c None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:56.551543 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-44c2627b-f991-4498-b391-7c64e8e1402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:56.657254 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1282/2538] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:47:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:56.671828 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:56.673486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:56.794452 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa867f6-50f7-4524-9b97-914ed579120f service glance] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:56.802034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981cf48-d0c6-496b-9360-54b779c53b18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:56.802701 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981cf48-d0c6-496b-9360-54b779c53b18 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:56.803003 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981cf48-d0c6-496b-9360-54b779c53b18 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:56.803282 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981cf48-d0c6-496b-9360-54b779c53b18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:56.812674 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981cf48-d0c6-496b-9360-54b779c53b18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:56.814275 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981cf48-d0c6-496b-9360-54b779c53b18 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:56.823367 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1257/2539] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:47:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 16:48:01.263951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15144c-fc87-4a03-9fa3-fd75efc58245 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.265010 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15144c-fc87-4a03-9fa3-fd75efc58245 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.271745 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15144c-fc87-4a03-9fa3-fd75efc58245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.305612 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3b15144c-fc87-4a03-9fa3-fd75efc58245 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:01.310734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3b15144c-fc87-4a03-9fa3-fd75efc58245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:01.331830 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1283/2540] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 16:48:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:01.348145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981cf48-d0c6-496b-9360-54b779c53b18 service swift] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.363160 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981cf48-d0c6-496b-9360-54b779c53b18 service swift] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.370243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a399a64-640d-403c-ac5b-52b1a1bd6228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.371471 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399a64-640d-403c-ac5b-52b1a1bd6228 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.378000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399a64-640d-403c-ac5b-52b1a1bd6228 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.378763 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399a64-640d-403c-ac5b-52b1a1bd6228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.391627 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a399a64-640d-403c-ac5b-52b1a1bd6228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.393383 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a399a64-640d-403c-ac5b-52b1a1bd6228 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:01.402609 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1258/2541] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:48:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:48:03.554059 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15144c-fc87-4a03-9fa3-fd75efc58245 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:03.555697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3b15144c-fc87-4a03-9fa3-fd75efc58245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:03.628854 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15144c-fc87-4a03-9fa3-fd75efc58245 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:03.633839 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:03.635288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:03.635288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:03.635759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] PATH_INFO: `/v3/users/8f85454e20524acdb9d2dd01d8a71c27` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:03.637156 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f85454e20524acdb9d2dd01d8a71c27)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:03.639809 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:03.708992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f85454e20524acdb9d2dd01d8a71c27'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:03.728696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f85454e20524acdb9d2dd01d8a71c27'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:03.743110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f85454e20524acdb9d2dd01d8a71c27'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:03.744032 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f85454e20524acdb9d2dd01d8a71c27'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:03.768471 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-7be0896f-1eb5-46f7-96f0-3625f00cdf74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f85454e20524acdb9d2dd01d8a71c27'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:03.779105 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1284/2542] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:48:03 2022] DELETE /identity/v3/users/8f85454e20524acdb9d2dd01d8a71c27 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:04.132351 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a399a64-640d-403c-ac5b-52b1a1bd6228 service swift] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.144321 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a399a64-640d-403c-ac5b-52b1a1bd6228 service swift] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.233695 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.234660 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.235055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.235444 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] PATH_INFO: `/v3/projects/afe9c1d72ca84e33b3431738acf61295` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.236825 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe9c1d72ca84e33b3431738acf61295)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:04.238858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:04.304502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe9c1d72ca84e33b3431738acf61295', 'request_id': 'req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:04.313188 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe9c1d72ca84e33b3431738acf61295', 'request_id': 'req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:04.319365 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe9c1d72ca84e33b3431738acf61295', 'request_id': 'req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:04.330242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] The token cache is being invalidate because project afe9c1d72ca84e33b3431738acf61295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:04.330531 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:04.331208 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-9dfa3b52-3a68-4e15-a2ce-338e58be79b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:04.332770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1259/2543] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:48:04 2022] DELETE /identity/v3/projects/afe9c1d72ca84e33b3431738acf61295 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:04.338251 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039088bc-a068-41a5-8082-e6a6ba64c6e7 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.338587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039088bc-a068-41a5-8082-e6a6ba64c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.338869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039088bc-a068-41a5-8082-e6a6ba64c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.357608 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-039088bc-a068-41a5-8082-e6a6ba64c6e7 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:04.358816 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-039088bc-a068-41a5-8082-e6a6ba64c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:04.429735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1285/2544] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:04.431421 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab0b5f-5d09-4414-8ca1-4a67929d9818 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.431769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab0b5f-5d09-4414-8ca1-4a67929d9818 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.432001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab0b5f-5d09-4414-8ca1-4a67929d9818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.451811 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-ccab0b5f-5d09-4414-8ca1-4a67929d9818 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:04.453049 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-ccab0b5f-5d09-4414-8ca1-4a67929d9818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:04.461292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1260/2545] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:04.465264 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039088bc-a068-41a5-8082-e6a6ba64c6e7 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.475774 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039088bc-a068-41a5-8082-e6a6ba64c6e7 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.485738 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.486529 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.486810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.487116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.487846 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:04.488146 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:04.489765 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:04.505440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1286/2546] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:04.507484 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab0b5f-5d09-4414-8ca1-4a67929d9818 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.518415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab0b5f-5d09-4414-8ca1-4a67929d9818 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.524382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e221187-47cd-4140-9f5f-ef3bdbe15465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.525058 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221187-47cd-4140-9f5f-ef3bdbe15465 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.525340 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221187-47cd-4140-9f5f-ef3bdbe15465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.525620 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221187-47cd-4140-9f5f-ef3bdbe15465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.526347 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e221187-47cd-4140-9f5f-ef3bdbe15465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:04.528306 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e221187-47cd-4140-9f5f-ef3bdbe15465 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:04.558201 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1261/2547] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:04.560880 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.570870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80dbd8-b61f-453f-8d17-b5d0ca7ef23d admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.635359 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06885921-a70d-4de7-89e3-ff979f312420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.636268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885921-a70d-4de7-89e3-ff979f312420 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.636626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885921-a70d-4de7-89e3-ff979f312420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.636909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06885921-a70d-4de7-89e3-ff979f312420 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.638526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06885921-a70d-4de7-89e3-ff979f312420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:04.640695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06885921-a70d-4de7-89e3-ff979f312420 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:04.663273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1287/2548] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:04.667409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e221187-47cd-4140-9f5f-ef3bdbe15465 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.678631 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e221187-47cd-4140-9f5f-ef3bdbe15465 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.683592 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cf4a1-e540-4c7d-b436-825087425efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.684197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf4a1-e540-4c7d-b436-825087425efd admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.684481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf4a1-e540-4c7d-b436-825087425efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.684783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf4a1-e540-4c7d-b436-825087425efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.685549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cf4a1-e540-4c7d-b436-825087425efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:04.687411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cf4a1-e540-4c7d-b436-825087425efd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:04.700207 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1262/2549] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:04.704357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06885921-a70d-4de7-89e3-ff979f312420 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.714273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06885921-a70d-4de7-89e3-ff979f312420 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.719676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e4f61-7b96-4aa1-b522-57d3912b0940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.720331 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e4f61-7b96-4aa1-b522-57d3912b0940 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.720618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e4f61-7b96-4aa1-b522-57d3912b0940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.720896 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e4f61-7b96-4aa1-b522-57d3912b0940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.721623 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e4f61-7b96-4aa1-b522-57d3912b0940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:04.723289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e4f61-7b96-4aa1-b522-57d3912b0940 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:04.735164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1288/2550] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:04.738299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cf4a1-e540-4c7d-b436-825087425efd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.749048 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cf4a1-e540-4c7d-b436-825087425efd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.757978 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.759112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.759395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.759670 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] PATH_INFO: `/v3/projects/2ad26c31da7f496c9e5e4b0763e8e8af/users/4a875b5444884c2494dfaaae4a1a9fbe/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.775804 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad26c31da7f496c9e5e4b0763e8e8af, user_id=4a875b5444884c2494dfaaae4a1a9fbe, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:04.778469 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:04.794453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1263/2551] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:48:04 2022] PUT /identity/v3/projects/2ad26c31da7f496c9e5e4b0763e8e8af/users/4a875b5444884c2494dfaaae4a1a9fbe/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:04.804518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a848-8602-4d13-b820-988ee05d32b9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.804812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a848-8602-4d13-b820-988ee05d32b9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.805112 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a848-8602-4d13-b820-988ee05d32b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.838996 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5a91a848-8602-4d13-b820-988ee05d32b9 None None] MFA Rules not processed for user `4a875b5444884c2494dfaaae4a1a9fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:04.840316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5a91a848-8602-4d13-b820-988ee05d32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:04.916180 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1289/2552] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:04.929594 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.932591 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:05.047406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8edfa-2940-41a6-bb96-369cb1fff798 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:05.052221 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfa3b7-c565-4d2a-ab9c-720bd6bc132f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:05.053102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfa3b7-c565-4d2a-ab9c-720bd6bc132f service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:05.053596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfa3b7-c565-4d2a-ab9c-720bd6bc132f service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:05.054078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfa3b7-c565-4d2a-ab9c-720bd6bc132f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:05.081155 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfa3b7-c565-4d2a-ab9c-720bd6bc132f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:05.082744 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfa3b7-c565-4d2a-ab9c-720bd6bc132f service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:05.093326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1264/2553] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:11.823502 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91a848-8602-4d13-b820-988ee05d32b9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:11.824951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5a91a848-8602-4d13-b820-988ee05d32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:11.896211 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91a848-8602-4d13-b820-988ee05d32b9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:11.900535 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:11.901350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:11.901892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:11.902222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:11.904515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:11.974268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:11.976346 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:11.987633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1290/2554] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:12.906671 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfa3b7-c565-4d2a-ab9c-720bd6bc132f service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:12.915835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfa3b7-c565-4d2a-ab9c-720bd6bc132f service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:12.919567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf04d7b-5ad7-4aac-88d9-b6c84205dc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:12.920205 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04d7b-5ad7-4aac-88d9-b6c84205dc39 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:12.920502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04d7b-5ad7-4aac-88d9-b6c84205dc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:12.920770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04d7b-5ad7-4aac-88d9-b6c84205dc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:12.922527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3bf04d7b-5ad7-4aac-88d9-b6c84205dc39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:12.999191 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf04d7b-5ad7-4aac-88d9-b6c84205dc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:13.003237 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf04d7b-5ad7-4aac-88d9-b6c84205dc39 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:13.014086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1265/2555] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:16.137445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:16.139665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:16.236986 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68841d-b86a-4cde-8bbf-3bb9c37f5ea6 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:16.242232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ed36df893640fc929d7953751d1116', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:16.242922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:16.243246 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:16.243522 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:16.245324 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:16.256831 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:16.258409 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:16.268549 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1291/2556] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:23.677233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717463a-6712-4cf0-9d8b-8b01f4f19fcf None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.677708 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717463a-6712-4cf0-9d8b-8b01f4f19fcf None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.677820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717463a-6712-4cf0-9d8b-8b01f4f19fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.695512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-3717463a-6712-4cf0-9d8b-8b01f4f19fcf None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:23.697146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3717463a-6712-4cf0-9d8b-8b01f4f19fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:23.753234 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1266/2557] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 16:48:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:23.774501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:23.775917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:23.842281 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444972e-ca0b-495e-a869-243c4d9fc3bb service placement] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:23.847150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621c0c6-c1ab-4262-bcbd-fbef046ecb31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:23.847822 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c0c6-c1ab-4262-bcbd-fbef046ecb31 service swift] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.848132 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c0c6-c1ab-4262-bcbd-fbef046ecb31 service swift] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.848410 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621c0c6-c1ab-4262-bcbd-fbef046ecb31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.856225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621c0c6-c1ab-4262-bcbd-fbef046ecb31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:23.858390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621c0c6-c1ab-4262-bcbd-fbef046ecb31 service swift] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:23.866170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1292/2558] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:48:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:48:31.822572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717463a-6712-4cf0-9d8b-8b01f4f19fcf None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:31.824052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3717463a-6712-4cf0-9d8b-8b01f4f19fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:31.893404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717463a-6712-4cf0-9d8b-8b01f4f19fcf None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:31.901413 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:31.902286 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.902568 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.902846 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] PATH_INFO: `/v3/users/437a2c1b2a04411abf858202c311dc1c` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.904078 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=437a2c1b2a04411abf858202c311dc1c)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:31.905979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:31.961184 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437a2c1b2a04411abf858202c311dc1c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.970439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437a2c1b2a04411abf858202c311dc1c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.978294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437a2c1b2a04411abf858202c311dc1c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.979163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437a2c1b2a04411abf858202c311dc1c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.992573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437a2c1b2a04411abf858202c311dc1c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.999349 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1267/2559] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:48:31 2022] DELETE /identity/v3/users/437a2c1b2a04411abf858202c311dc1c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:32.004055 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0569fe-9611-4c80-beb2-868a2c9f5b24 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.004566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0569fe-9611-4c80-beb2-868a2c9f5b24 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.004889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0569fe-9611-4c80-beb2-868a2c9f5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.022926 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-fc0569fe-9611-4c80-beb2-868a2c9f5b24 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:32.024368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fc0569fe-9611-4c80-beb2-868a2c9f5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:32.085022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1293/2560] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:32.095370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.096821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:32.156377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc48084-1d2e-46e7-a5ed-60512ca68ff6 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.160212 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf445b3-7c00-491b-9a65-6c8d62f65107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.160859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf445b3-7c00-491b-9a65-6c8d62f65107 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.161137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf445b3-7c00-491b-9a65-6c8d62f65107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.161409 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf445b3-7c00-491b-9a65-6c8d62f65107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.171016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf445b3-7c00-491b-9a65-6c8d62f65107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.172524 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf445b3-7c00-491b-9a65-6c8d62f65107 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.182547 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1268/2561] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:32.473385 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0569fe-9611-4c80-beb2-868a2c9f5b24 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.477982 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-fc0569fe-9611-4c80-beb2-868a2c9f5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:32.487810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0569fe-9611-4c80-beb2-868a2c9f5b24 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.492626 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.493494 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.493771 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.494042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] PATH_INFO: `/v3/projects/772edda19c464d5c91366a7b6a9cc424` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.495312 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=772edda19c464d5c91366a7b6a9cc424)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.497302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.545244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772edda19c464d5c91366a7b6a9cc424', 'request_id': 'req-693b13f6-7cc7-4fac-89d2-5395d460a03b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:32.552564 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772edda19c464d5c91366a7b6a9cc424', 'request_id': 'req-693b13f6-7cc7-4fac-89d2-5395d460a03b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:32.557922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772edda19c464d5c91366a7b6a9cc424', 'request_id': 'req-693b13f6-7cc7-4fac-89d2-5395d460a03b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:32.569647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] The token cache is being invalidate because project 772edda19c464d5c91366a7b6a9cc424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:32.569935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:32.570606 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-693b13f6-7cc7-4fac-89d2-5395d460a03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:32.572341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1294/2562] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:48:32 2022] DELETE /identity/v3/projects/772edda19c464d5c91366a7b6a9cc424 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:32.577654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d061-fd76-4d46-8427-361abd0c5f43 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.578019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d061-fd76-4d46-8427-361abd0c5f43 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.578305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d061-fd76-4d46-8427-361abd0c5f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.596101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-91a3d061-fd76-4d46-8427-361abd0c5f43 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:32.597196 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-91a3d061-fd76-4d46-8427-361abd0c5f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:32.655110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1269/2563] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:32.663186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8839-d075-4c7c-a17f-3a3578fada36 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.663506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8839-d075-4c7c-a17f-3a3578fada36 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.663824 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8839-d075-4c7c-a17f-3a3578fada36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.683393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-673c8839-d075-4c7c-a17f-3a3578fada36 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:32.684588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-673c8839-d075-4c7c-a17f-3a3578fada36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:32.694848 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1295/2564] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:32.699102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d061-fd76-4d46-8427-361abd0c5f43 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.709139 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d061-fd76-4d46-8427-361abd0c5f43 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.713765 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.714406 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.714684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.714954 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.715697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:32.716000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.718186 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.729200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1270/2565] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:32.733571 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c8839-d075-4c7c-a17f-3a3578fada36 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.742391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c8839-d075-4c7c-a17f-3a3578fada36 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.747014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f12cdb-beb6-4fb2-ab5f-4a48c6dbdcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.747749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12cdb-beb6-4fb2-ab5f-4a48c6dbdcda admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.748031 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12cdb-beb6-4fb2-ab5f-4a48c6dbdcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.748310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12cdb-beb6-4fb2-ab5f-4a48c6dbdcda admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.749014 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f12cdb-beb6-4fb2-ab5f-4a48c6dbdcda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.751868 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f12cdb-beb6-4fb2-ab5f-4a48c6dbdcda admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.782164 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1296/2566] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:48:32 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:32.786425 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.796054 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562e812-45fc-4343-97a8-815c75c4ccfd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.859588 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837e36-b2f9-45c9-ab83-83fe782e459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.860243 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837e36-b2f9-45c9-ab83-83fe782e459a admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.860558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837e36-b2f9-45c9-ab83-83fe782e459a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.860835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837e36-b2f9-45c9-ab83-83fe782e459a admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.861538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837e36-b2f9-45c9-ab83-83fe782e459a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.863455 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837e36-b2f9-45c9-ab83-83fe782e459a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.884525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1271/2567] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:48:32 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:32.889531 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f12cdb-beb6-4fb2-ab5f-4a48c6dbdcda admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.899799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f12cdb-beb6-4fb2-ab5f-4a48c6dbdcda admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.904350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032af8d-89f7-466b-b141-f46bf0281d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.905034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032af8d-89f7-466b-b141-f46bf0281d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.905315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032af8d-89f7-466b-b141-f46bf0281d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.905587 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032af8d-89f7-466b-b141-f46bf0281d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.906303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032af8d-89f7-466b-b141-f46bf0281d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.907907 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032af8d-89f7-466b-b141-f46bf0281d4f admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.918120 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1297/2568] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:32.922015 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837e36-b2f9-45c9-ab83-83fe782e459a admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.932063 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837e36-b2f9-45c9-ab83-83fe782e459a admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.937112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6502-4be9-498a-838f-18826af94a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.937761 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6502-4be9-498a-838f-18826af94a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.938042 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6502-4be9-498a-838f-18826af94a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.938338 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6502-4be9-498a-838f-18826af94a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.939096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f6502-4be9-498a-838f-18826af94a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.940679 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f6502-4be9-498a-838f-18826af94a98 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.950150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1272/2569] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:32.955640 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032af8d-89f7-466b-b141-f46bf0281d4f admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.965720 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032af8d-89f7-466b-b141-f46bf0281d4f admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.970303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.971227 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.971510 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.971789 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] PATH_INFO: `/v3/projects/9a3b2026707b413195eed506c75fcee3/users/8145895f4cec444f9d09a342b3769a6e/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.985602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3b2026707b413195eed506c75fcee3, user_id=8145895f4cec444f9d09a342b3769a6e, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.988278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:33.000808 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1298/2570] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:48:32 2022] PUT /identity/v3/projects/9a3b2026707b413195eed506c75fcee3/users/8145895f4cec444f9d09a342b3769a6e/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:33.011486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b0d0-6336-40e1-ad14-aba848208588 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:33.011778 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b0d0-6336-40e1-ad14-aba848208588 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:33.012055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b0d0-6336-40e1-ad14-aba848208588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:33.038566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5ee7b0d0-6336-40e1-ad14-aba848208588 None None] MFA Rules not processed for user `8145895f4cec444f9d09a342b3769a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:33.039819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5ee7b0d0-6336-40e1-ad14-aba848208588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:33.111903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1273/2571] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:33.122428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:33.124800 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:33.180795 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfdea7-de54-46fc-8606-b5d6dbf557a0 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:33.184763 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c219506-81eb-42fe-a288-c09329a99475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:33.185958 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219506-81eb-42fe-a288-c09329a99475 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:33.186238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219506-81eb-42fe-a288-c09329a99475 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:33.186513 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219506-81eb-42fe-a288-c09329a99475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:33.194825 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c219506-81eb-42fe-a288-c09329a99475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:33.196277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c219506-81eb-42fe-a288-c09329a99475 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:33.205364 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1299/2572] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:47.240120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b0d0-6336-40e1-ad14-aba848208588 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:47.300142 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b0d0-6336-40e1-ad14-aba848208588 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:47.305004 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:47.305866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.306145 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.306419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] PATH_INFO: `/v3/users/8145895f4cec444f9d09a342b3769a6e` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.307610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8145895f4cec444f9d09a342b3769a6e)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:47.309520 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:47.352265 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8145895f4cec444f9d09a342b3769a6e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.359470 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8145895f4cec444f9d09a342b3769a6e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.366481 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8145895f4cec444f9d09a342b3769a6e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.367182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8145895f4cec444f9d09a342b3769a6e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.378605 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8145895f4cec444f9d09a342b3769a6e'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.384602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1274/2573] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:48:47 2022] DELETE /identity/v3/users/8145895f4cec444f9d09a342b3769a6e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:47.389186 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed34a-e499-4d12-804c-dcb766fb04de None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.389679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed34a-e499-4d12-804c-dcb766fb04de None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.389791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed34a-e499-4d12-804c-dcb766fb04de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.406367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-0faed34a-e499-4d12-804c-dcb766fb04de None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:47.407556 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0faed34a-e499-4d12-804c-dcb766fb04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.463435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1300/2574] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:47.473559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:47.474904 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.530123 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be764-a246-48c1-899d-c4514d09ed57 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:47.533783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:47.534502 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.534792 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.535110 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.543890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:47.545368 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:47.555017 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1275/2575] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:47.809185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed34a-e499-4d12-804c-dcb766fb04de None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:47.810631 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-0faed34a-e499-4d12-804c-dcb766fb04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.822279 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed34a-e499-4d12-804c-dcb766fb04de None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:47.828008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:47.828962 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.829311 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.830247 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] PATH_INFO: `/v3/projects/9a3b2026707b413195eed506c75fcee3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.832025 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3b2026707b413195eed506c75fcee3)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:47.833916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:47.880083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3b2026707b413195eed506c75fcee3', 'request_id': 'req-a67c7edb-298b-402d-b13f-b4460078ae87'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.887726 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3b2026707b413195eed506c75fcee3', 'request_id': 'req-a67c7edb-298b-402d-b13f-b4460078ae87'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.894099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3b2026707b413195eed506c75fcee3', 'request_id': 'req-a67c7edb-298b-402d-b13f-b4460078ae87'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.904903 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] The token cache is being invalidate because project 9a3b2026707b413195eed506c75fcee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:47.905190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.905813 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-a67c7edb-298b-402d-b13f-b4460078ae87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.907383 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1301/2576] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:48:47 2022] DELETE /identity/v3/projects/9a3b2026707b413195eed506c75fcee3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:55.851174 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.852579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:55.865723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954e001-8b90-4200-9058-c2cf241f041c service neutron] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.918738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.920116 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.920389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.920656 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] PATH_INFO: `/v3/users/4a875b5444884c2494dfaaae4a1a9fbe` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.921821 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a875b5444884c2494dfaaae4a1a9fbe)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.923745 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.967329 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a875b5444884c2494dfaaae4a1a9fbe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.973776 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a875b5444884c2494dfaaae4a1a9fbe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.980820 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a875b5444884c2494dfaaae4a1a9fbe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.981422 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a875b5444884c2494dfaaae4a1a9fbe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.993258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a875b5444884c2494dfaaae4a1a9fbe'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.999525 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1276/2577] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:48:55 2022] DELETE /identity/v3/users/4a875b5444884c2494dfaaae4a1a9fbe => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:56.003932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33164e8b-f341-47e7-bd4a-4e4d1c8e2bd0 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.004393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33164e8b-f341-47e7-bd4a-4e4d1c8e2bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.004611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33164e8b-f341-47e7-bd4a-4e4d1c8e2bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.022633 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-33164e8b-f341-47e7-bd4a-4e4d1c8e2bd0 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:56.024194 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-33164e8b-f341-47e7-bd4a-4e4d1c8e2bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.084504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1302/2578] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:56.094411 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.095823 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.154682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742551c6-335b-4a9b-af7e-6e650c0278a4 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.158358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888d83a-9059-470d-94d5-293016186ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.159021 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d83a-9059-470d-94d5-293016186ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.159307 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d83a-9059-470d-94d5-293016186ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.159581 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d83a-9059-470d-94d5-293016186ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.168297 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888d83a-9059-470d-94d5-293016186ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.170291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888d83a-9059-470d-94d5-293016186ab9 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.180050 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1277/2579] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:56.438645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33164e8b-f341-47e7-bd4a-4e4d1c8e2bd0 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.440244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-33164e8b-f341-47e7-bd4a-4e4d1c8e2bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.455295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33164e8b-f341-47e7-bd4a-4e4d1c8e2bd0 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.461083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.462204 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.462695 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.463022 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] PATH_INFO: `/v3/projects/2ad26c31da7f496c9e5e4b0763e8e8af` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.464482 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad26c31da7f496c9e5e4b0763e8e8af)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.467229 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.512214 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad26c31da7f496c9e5e4b0763e8e8af', 'request_id': 'req-f125cc0e-3331-4026-989a-1a8f6136b88d'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:56.519501 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad26c31da7f496c9e5e4b0763e8e8af', 'request_id': 'req-f125cc0e-3331-4026-989a-1a8f6136b88d'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:56.524752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad26c31da7f496c9e5e4b0763e8e8af', 'request_id': 'req-f125cc0e-3331-4026-989a-1a8f6136b88d'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:56.536152 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] The token cache is being invalidate because project 2ad26c31da7f496c9e5e4b0763e8e8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:56.536435 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:56.537050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-f125cc0e-3331-4026-989a-1a8f6136b88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:56.538559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1303/2580] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:48:56 2022] DELETE /identity/v3/projects/2ad26c31da7f496c9e5e4b0763e8e8af => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:56.544789 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756a03-68c6-4bcf-a400-3ac1102a9af6 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.545075 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756a03-68c6-4bcf-a400-3ac1102a9af6 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.545348 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756a03-68c6-4bcf-a400-3ac1102a9af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.562668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-b1756a03-68c6-4bcf-a400-3ac1102a9af6 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:56.563871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-b1756a03-68c6-4bcf-a400-3ac1102a9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.619859 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1278/2581] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:56.629999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d33f0-7002-47a2-8f37-f302d26f2012 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.630288 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d33f0-7002-47a2-8f37-f302d26f2012 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.630696 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d33f0-7002-47a2-8f37-f302d26f2012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.650898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-8c1d33f0-7002-47a2-8f37-f302d26f2012 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:56.652110 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-8c1d33f0-7002-47a2-8f37-f302d26f2012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.660641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1304/2582] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:56.664713 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1756a03-68c6-4bcf-a400-3ac1102a9af6 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.674108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1756a03-68c6-4bcf-a400-3ac1102a9af6 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.678907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.679602 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.679880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.680151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.680867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:56.681176 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.682741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.694461 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1279/2583] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:56.698476 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d33f0-7002-47a2-8f37-f302d26f2012 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.707920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d33f0-7002-47a2-8f37-f302d26f2012 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.712479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a714ad-0cc1-4dd5-aa20-00167ea98c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.713115 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a714ad-0cc1-4dd5-aa20-00167ea98c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.713392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a714ad-0cc1-4dd5-aa20-00167ea98c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.713657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a714ad-0cc1-4dd5-aa20-00167ea98c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.714337 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a714ad-0cc1-4dd5-aa20-00167ea98c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.716969 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a714ad-0cc1-4dd5-aa20-00167ea98c91 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.740703 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1305/2584] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:48:56 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:56.744862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.754563 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed971473-0274-495a-b443-19ae08f44c37 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.807875 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02025-a566-44e6-bc64-aa637d00e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.808527 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02025-a566-44e6-bc64-aa637d00e176 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.808805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02025-a566-44e6-bc64-aa637d00e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.809077 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02025-a566-44e6-bc64-aa637d00e176 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.809740 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b02025-a566-44e6-bc64-aa637d00e176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.811683 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b02025-a566-44e6-bc64-aa637d00e176 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.831579 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1280/2585] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:48:56 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:56.835747 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a714ad-0cc1-4dd5-aa20-00167ea98c91 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.846394 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a714ad-0cc1-4dd5-aa20-00167ea98c91 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.858258 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c1a86-d127-442d-b095-2ca44f6e7320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.858944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c1a86-d127-442d-b095-2ca44f6e7320 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.859252 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c1a86-d127-442d-b095-2ca44f6e7320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.859552 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c1a86-d127-442d-b095-2ca44f6e7320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.860308 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c1a86-d127-442d-b095-2ca44f6e7320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.861889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c1a86-d127-442d-b095-2ca44f6e7320 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.872834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1306/2586] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:56.876728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02025-a566-44e6-bc64-aa637d00e176 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.886714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02025-a566-44e6-bc64-aa637d00e176 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.892012 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd78ad-1c26-433c-a830-4249a1028938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.892659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd78ad-1c26-433c-a830-4249a1028938 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.892968 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd78ad-1c26-433c-a830-4249a1028938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.893260 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd78ad-1c26-433c-a830-4249a1028938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.893982 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd78ad-1c26-433c-a830-4249a1028938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.895616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd78ad-1c26-433c-a830-4249a1028938 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.905799 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1281/2587] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:56.909922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c1a86-d127-442d-b095-2ca44f6e7320 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.920344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c1a86-d127-442d-b095-2ca44f6e7320 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.925399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.927248 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.927711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.927999 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] PATH_INFO: `/v3/projects/80fbae61b8514d0593f2a6f2d5e74135/users/f8968bd9289241e1afd6ae160cd3019a/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.942649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fbae61b8514d0593f2a6f2d5e74135, user_id=f8968bd9289241e1afd6ae160cd3019a, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.945323 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.959454 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1307/2588] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:48:56 2022] PUT /identity/v3/projects/80fbae61b8514d0593f2a6f2d5e74135/users/f8968bd9289241e1afd6ae160cd3019a/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:56.969645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ffe0-2be9-4594-b376-5dfde5ebac38 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.969931 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ffe0-2be9-4594-b376-5dfde5ebac38 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.970206 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ffe0-2be9-4594-b376-5dfde5ebac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.995924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-a038ffe0-2be9-4594-b376-5dfde5ebac38 None None] MFA Rules not processed for user `f8968bd9289241e1afd6ae160cd3019a`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:56.997157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a038ffe0-2be9-4594-b376-5dfde5ebac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:57.058920 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1282/2589] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:57.070504 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:57.072326 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:57.128525 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e9e47-d179-4c6e-9cc6-eef2bcc13484 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:57.132558 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73fe9a-3638-49a4-9484-744c0d11189f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:57.133200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73fe9a-3638-49a4-9484-744c0d11189f service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:57.133477 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73fe9a-3638-49a4-9484-744c0d11189f service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:57.133871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73fe9a-3638-49a4-9484-744c0d11189f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:57.143121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73fe9a-3638-49a4-9484-744c0d11189f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:57.144526 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73fe9a-3638-49a4-9484-744c0d11189f service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:57.153042 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1308/2590] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:57.178258 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038ffe0-2be9-4594-b376-5dfde5ebac38 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:57.239856 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038ffe0-2be9-4594-b376-5dfde5ebac38 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:57.244501 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:57.245363 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:57.245642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:57.245919 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] PATH_INFO: `/v3/users/f8968bd9289241e1afd6ae160cd3019a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:57.247158 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8968bd9289241e1afd6ae160cd3019a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:57.249686 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:57.293381 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8968bd9289241e1afd6ae160cd3019a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.300373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8968bd9289241e1afd6ae160cd3019a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.307312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8968bd9289241e1afd6ae160cd3019a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.307951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8968bd9289241e1afd6ae160cd3019a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.319960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8968bd9289241e1afd6ae160cd3019a'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.325801 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1283/2591] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:48:57 2022] DELETE /identity/v3/users/f8968bd9289241e1afd6ae160cd3019a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:57.330219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d144e2-6f9e-4073-8422-705b15289538 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:57.330503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d144e2-6f9e-4073-8422-705b15289538 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:57.330776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d144e2-6f9e-4073-8422-705b15289538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:57.347219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-12d144e2-6f9e-4073-8422-705b15289538 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:57.348387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-12d144e2-6f9e-4073-8422-705b15289538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:57.403812 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1309/2592] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:57.413217 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:57.414604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:57.470060 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fec31a-0b28-4dd2-8ec3-67e2d4858dcb admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:57.473741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc39954-1f22-4d3c-b80d-ef8cda71fb4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:57.474382 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39954-1f22-4d3c-b80d-ef8cda71fb4f service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:57.474662 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39954-1f22-4d3c-b80d-ef8cda71fb4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:57.474937 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39954-1f22-4d3c-b80d-ef8cda71fb4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:57.484261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc39954-1f22-4d3c-b80d-ef8cda71fb4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:57.485682 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc39954-1f22-4d3c-b80d-ef8cda71fb4f service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:57.495438 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1284/2593] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:57.751908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d144e2-6f9e-4073-8422-705b15289538 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:57.753303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-12d144e2-6f9e-4073-8422-705b15289538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:57.764810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d144e2-6f9e-4073-8422-705b15289538 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:57.769286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:57.770139 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:57.770411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:57.770679 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] PATH_INFO: `/v3/projects/80fbae61b8514d0593f2a6f2d5e74135` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:57.771941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fbae61b8514d0593f2a6f2d5e74135)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:57.773752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:57.819283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fbae61b8514d0593f2a6f2d5e74135', 'request_id': 'req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.826897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fbae61b8514d0593f2a6f2d5e74135', 'request_id': 'req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.832432 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fbae61b8514d0593f2a6f2d5e74135', 'request_id': 'req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.843863 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] The token cache is being invalidate because project 80fbae61b8514d0593f2a6f2d5e74135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:57.844149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.844775 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-165c814f-e1d6-4c4a-91a4-c8a34d652bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.846298 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1310/2594] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:48:57 2022] DELETE /identity/v3/projects/80fbae61b8514d0593f2a6f2d5e74135 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:58.120240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810255c-9687-412e-8bf5-4f85e54ff9ba None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.120725 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810255c-9687-412e-8bf5-4f85e54ff9ba None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.120818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810255c-9687-412e-8bf5-4f85e54ff9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.137589 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-9810255c-9687-412e-8bf5-4f85e54ff9ba None None] MFA Rules not processed for user `80f1e7854604414e8174b87e039ef401`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:58.139326 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9810255c-9687-412e-8bf5-4f85e54ff9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:58.191815 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1285/2595] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:48:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:37.543600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dcb5b-2c83-42d3-ab18-7ef83b9ab9b9 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:37.544139 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dcb5b-2c83-42d3-ab18-7ef83b9ab9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:37.544242 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dcb5b-2c83-42d3-ab18-7ef83b9ab9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:37.562750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-7b4dcb5b-2c83-42d3-ab18-7ef83b9ab9b9 None None] MFA Rules not processed for user `48a7478e69d740e89da1201c954cbfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:37.563968 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7b4dcb5b-2c83-42d3-ab18-7ef83b9ab9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:37.614981 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1311/2596] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:49:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:38.159744 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2f13-c9e4-4519-8b6b-7e975f9e9520 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:38.160327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2f13-c9e4-4519-8b6b-7e975f9e9520 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:38.160327 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2f13-c9e4-4519-8b6b-7e975f9e9520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:38.178812 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-5b9c2f13-c9e4-4519-8b6b-7e975f9e9520 None None] MFA Rules not processed for user `de5e76d5385f44fab03527751a478f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:38.180200 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-5b9c2f13-c9e4-4519-8b6b-7e975f9e9520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:38.237254 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1286/2597] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:49:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:06.262484 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dcb5b-2c83-42d3-ab18-7ef83b9ab9b9 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:06.263976 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-7b4dcb5b-2c83-42d3-ab18-7ef83b9ab9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:06.328419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dcb5b-2c83-42d3-ab18-7ef83b9ab9b9 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:06.332799 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:06.333662 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:06.333941 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:06.334216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] PATH_INFO: `/v3/users/80f1e7854604414e8174b87e039ef401` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:06.335613 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f1e7854604414e8174b87e039ef401)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:06.337516 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:06.383216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f1e7854604414e8174b87e039ef401'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.389834 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f1e7854604414e8174b87e039ef401'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.397054 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f1e7854604414e8174b87e039ef401'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.397727 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f1e7854604414e8174b87e039ef401'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.409222 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f1e7854604414e8174b87e039ef401'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.415153 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1312/2598] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:50:06 2022] DELETE /identity/v3/users/80f1e7854604414e8174b87e039ef401 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:06.581991 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2f13-c9e4-4519-8b6b-7e975f9e9520 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:06.592949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2f13-c9e4-4519-8b6b-7e975f9e9520 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:06.650552 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:06.651436 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:06.651715 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:06.651984 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] PATH_INFO: `/v3/projects/aae4278fddbd44cbb508e4fa63f9f7a4` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:06.653143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae4278fddbd44cbb508e4fa63f9f7a4)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:06.655074 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:06.701902 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'request_id': 'req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.708719 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'request_id': 'req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.713927 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'request_id': 'req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.725045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] The token cache is being invalidate because project aae4278fddbd44cbb508e4fa63f9f7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:06.725331 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.725936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:06.727500 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1287/2599] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:50:06 2022] DELETE /identity/v3/projects/aae4278fddbd44cbb508e4fa63f9f7a4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:17.186000 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.187424 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.242280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3ebb-3477-49b7-9e2d-0554b1c12beb admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.292107 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.292866 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.293150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.293443 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.295393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.352952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.355690 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.367253 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1313/2600] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:17.468372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.469749 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.481562 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8684ea-0dff-4d77-9a24-f9e46e7b91bc admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.485299 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.485929 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.486209 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.486486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.488292 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.555949 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.557408 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.568513 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1288/2601] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:20.223917 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:20.225393 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:20.279515 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a653f0-2672-4c70-9294-ee5a05d6f5f6 service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:20.283075 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:20.283717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:20.283997 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:20.284273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:20.286593 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:20.299705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:20.301129 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:20.312172 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1314/2602] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:29.677034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:29.678849 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:29.694151 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf638-c824-43ea-b1ff-47cba8fc9bcd service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:29.699580 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:29.700211 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:29.700489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:29.700756 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:29.702424 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:29.758090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:29.759775 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:29.768851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1289/2603] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:30.842309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:30.856295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b33a5-03a9-4045-b9b7-adb3d0db764c service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:30.862824 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:30.864058 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:30.864582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:30.865076 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:30.867377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:30.886043 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:30.887891 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:30.900828 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1315/2604] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:36.194906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:36.203948 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88716ad0-d6c4-4a2f-9a4f-31b300dd9f69 service nova] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:36.207923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb11b4-8706-419c-9cfa-0ff869b6f636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:36.208544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb11b4-8706-419c-9cfa-0ff869b6f636 service neutron] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:36.208819 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb11b4-8706-419c-9cfa-0ff869b6f636 service neutron] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:36.209089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb11b4-8706-419c-9cfa-0ff869b6f636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:36.210808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-6fdb11b4-8706-419c-9cfa-0ff869b6f636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:36.268986 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb11b4-8706-419c-9cfa-0ff869b6f636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:36.270852 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb11b4-8706-419c-9cfa-0ff869b6f636 service neutron] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:36.280165 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1290/2605] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:41.185048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:41.187226 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:41.205705 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9170f4-2166-4457-bb4f-3ce3b512c5d1 service nova] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:41.210872 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:41.211911 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.212220 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.212489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] PATH_INFO: `/v3/users/de5e76d5385f44fab03527751a478f1e` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.213685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5e76d5385f44fab03527751a478f1e)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:41.216074 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:41.274407 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5e76d5385f44fab03527751a478f1e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.278770 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5e76d5385f44fab03527751a478f1e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.283189 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd46a2-32bf-484a-93da-1d99b8a24dbd None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.283967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd46a2-32bf-484a-93da-1d99b8a24dbd None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.283967 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd46a2-32bf-484a-93da-1d99b8a24dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.286656 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5e76d5385f44fab03527751a478f1e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.287419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5e76d5385f44fab03527751a478f1e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.300295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5e76d5385f44fab03527751a478f1e'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.303687 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-27cd46a2-32bf-484a-93da-1d99b8a24dbd None None] MFA Rules not processed for user `1bc2420288964c389f6529d9ede09bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:41.304977 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-27cd46a2-32bf-484a-93da-1d99b8a24dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:41.307864 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1316/2606] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:50:41 2022] DELETE /identity/v3/users/de5e76d5385f44fab03527751a478f1e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:41.369530 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1291/2607] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:50:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:50:41.506752 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:41.508207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:41.589309 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb07cdc-4927-4500-8f03-33b5771461eb admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:41.594121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:41.595016 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.595303 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.595603 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] PATH_INFO: `/v3/projects/c0da2d582ad649208e7c4105faee8290` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.596845 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0da2d582ad649208e7c4105faee8290)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:41.599826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:41.646414 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0da2d582ad649208e7c4105faee8290', 'request_id': 'req-43109c4a-9f73-4244-96a4-f04c3189c3e3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.654193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0da2d582ad649208e7c4105faee8290', 'request_id': 'req-43109c4a-9f73-4244-96a4-f04c3189c3e3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.659871 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0da2d582ad649208e7c4105faee8290', 'request_id': 'req-43109c4a-9f73-4244-96a4-f04c3189c3e3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.670598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] The token cache is being invalidate because project c0da2d582ad649208e7c4105faee8290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:41.670884 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.671566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:41.673149 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1317/2608] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:50:41 2022] DELETE /identity/v3/projects/c0da2d582ad649208e7c4105faee8290 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:41.679291 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb393-0420-493e-91ce-0b0e818f622a None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.679584 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb393-0420-493e-91ce-0b0e818f622a None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.679864 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb393-0420-493e-91ce-0b0e818f622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.698029 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-df9cb393-0420-493e-91ce-0b0e818f622a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:41.699281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-df9cb393-0420-493e-91ce-0b0e818f622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:41.722922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:41.724342 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:41.761261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1292/2609] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:41.768800 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328eb5d-3d52-413c-9abf-ce7f1f63317e None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.769087 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328eb5d-3d52-413c-9abf-ce7f1f63317e None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.769370 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328eb5d-3d52-413c-9abf-ce7f1f63317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.786920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43109c4a-9f73-4244-96a4-f04c3189c3e3 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:41.787443 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-1328eb5d-3d52-413c-9abf-ce7f1f63317e None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:41.788634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-1328eb5d-3d52-413c-9abf-ce7f1f63317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:41.790777 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:41.791464 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.791772 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.792048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.793790 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:41.796751 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1293/2610] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:50:41.800565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328eb5d-3d52-413c-9abf-ce7f1f63317e None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:41.804108 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:41.805617 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:41.809990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328eb5d-3d52-413c-9abf-ce7f1f63317e None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:41.813850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1318/2611] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:50:41.814616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:41.815293 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.815575 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.815851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.817101 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:41.817402 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:41.819016 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:41.834457 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1294/2612] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:50:41.835522 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:41.846539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99ff6d-b18e-4e1d-b740-ce7b5ead26c8 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:41.851263 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25261521-cf54-4795-b2f7-007e1f2bee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:41.851908 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261521-cf54-4795-b2f7-007e1f2bee9a admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.852189 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261521-cf54-4795-b2f7-007e1f2bee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.852461 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25261521-cf54-4795-b2f7-007e1f2bee9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.853162 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25261521-cf54-4795-b2f7-007e1f2bee9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:41.855087 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25261521-cf54-4795-b2f7-007e1f2bee9a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:41.883094 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1319/2613] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:50:41 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:50:41.887491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:41.898906 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db19f8-72e9-48c0-888b-a863f0d5fc96 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:41.963448 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc26080-c119-4abf-bcff-3c1f68d67b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:41.964120 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc26080-c119-4abf-bcff-3c1f68d67b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.964395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc26080-c119-4abf-bcff-3c1f68d67b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.964666 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc26080-c119-4abf-bcff-3c1f68d67b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.965344 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc26080-c119-4abf-bcff-3c1f68d67b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:41.967284 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc26080-c119-4abf-bcff-3c1f68d67b24 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:41.987805 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1295/2614] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:50:41 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:41.992356 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25261521-cf54-4795-b2f7-007e1f2bee9a admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:42.002776 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25261521-cf54-4795-b2f7-007e1f2bee9a admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:42.008056 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b6897-47ec-46ed-9223-2f7c18378bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:42.008724 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b6897-47ec-46ed-9223-2f7c18378bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:42.009008 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b6897-47ec-46ed-9223-2f7c18378bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:42.009299 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b6897-47ec-46ed-9223-2f7c18378bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:42.010015 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b6897-47ec-46ed-9223-2f7c18378bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:42.011632 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b6897-47ec-46ed-9223-2f7c18378bfd admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:42.022646 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1320/2615] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:42.026617 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc26080-c119-4abf-bcff-3c1f68d67b24 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:42.036294 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc26080-c119-4abf-bcff-3c1f68d67b24 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:42.040938 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18875a-7da3-4cc5-891d-234868675f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:42.041595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18875a-7da3-4cc5-891d-234868675f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:42.041871 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18875a-7da3-4cc5-891d-234868675f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:42.042143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18875a-7da3-4cc5-891d-234868675f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:42.042862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18875a-7da3-4cc5-891d-234868675f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:42.044485 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18875a-7da3-4cc5-891d-234868675f10 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:42.058148 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1296/2616] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:50:42.059419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b6897-47ec-46ed-9223-2f7c18378bfd admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:42.071711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b6897-47ec-46ed-9223-2f7c18378bfd admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:42.076928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:42.077971 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:42.078325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:42.078668 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] PATH_INFO: `/v3/projects/c689db207d9b4ca7af21395734fc14d5/users/f037681adf2f4d5a8585e3a8820534ea/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:42.094750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c689db207d9b4ca7af21395734fc14d5, user_id=f037681adf2f4d5a8585e3a8820534ea, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:42.097604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:42.111239 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1321/2617] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:50:42 2022] PUT /identity/v3/projects/c689db207d9b4ca7af21395734fc14d5/users/f037681adf2f4d5a8585e3a8820534ea/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:42.116814 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e0c6-743b-4a64-9706-e2f8e5cd42a9 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:42.117107 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e0c6-743b-4a64-9706-e2f8e5cd42a9 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:42.117387 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e0c6-743b-4a64-9706-e2f8e5cd42a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:42.135857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-fb41e0c6-743b-4a64-9706-e2f8e5cd42a9 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:42.137127 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fb41e0c6-743b-4a64-9706-e2f8e5cd42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:42.205939 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1297/2618] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:42.213250 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:42.219069 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:42.284238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa984-7499-4a36-bfda-5049e44b1a45 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:42.288821 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb32f89-5b13-4e8f-b930-be4db1716131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:42.289955 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32f89-5b13-4e8f-b930-be4db1716131 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:42.290335 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32f89-5b13-4e8f-b930-be4db1716131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:42.290797 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32f89-5b13-4e8f-b930-be4db1716131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:42.303198 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb32f89-5b13-4e8f-b930-be4db1716131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:42.304850 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb32f89-5b13-4e8f-b930-be4db1716131 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:42.317418 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1322/2619] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:42.336166 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e0c6-743b-4a64-9706-e2f8e5cd42a9 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:42.337604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fb41e0c6-743b-4a64-9706-e2f8e5cd42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:42.416118 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e0c6-743b-4a64-9706-e2f8e5cd42a9 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:42.421491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a361d-8270-4276-81c5-1b0aa8f51038 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ed36df893640fc929d7953751d1116', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:42.422143 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a361d-8270-4276-81c5-1b0aa8f51038 service placement] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:42.422428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a361d-8270-4276-81c5-1b0aa8f51038 service placement] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:42.422707 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a361d-8270-4276-81c5-1b0aa8f51038 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:42.424541 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-873a361d-8270-4276-81c5-1b0aa8f51038 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:42.437289 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a361d-8270-4276-81c5-1b0aa8f51038 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:42.439137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a361d-8270-4276-81c5-1b0aa8f51038 service placement] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:42.450509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1298/2620] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:45.423539 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb32f89-5b13-4e8f-b930-be4db1716131 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:45.434065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb32f89-5b13-4e8f-b930-be4db1716131 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:45.440701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:45.441375 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:45.441663 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:45.441937 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:45.443992 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:45.464251 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:45.465734 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:45.474685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1323/2621] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:48.509559 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a33ec-f53f-48b5-ac7a-039d6cfecb4b None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:48.510114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a33ec-f53f-48b5-ac7a-039d6cfecb4b None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:48.510114 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a33ec-f53f-48b5-ac7a-039d6cfecb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:48.541619 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-d45a33ec-f53f-48b5-ac7a-039d6cfecb4b None None] MFA Rules not processed for user `f037681adf2f4d5a8585e3a8820534ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:48.542862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-d45a33ec-f53f-48b5-ac7a-039d6cfecb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:48.614404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1299/2622] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:48.628178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:48.630201 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:48.702348 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c742-6e27-413a-9047-0ec9167d4567 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:48.708685 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452afd0-9e1a-4e80-aaf7-f48c5c36350c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:48.709332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452afd0-9e1a-4e80-aaf7-f48c5c36350c service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:48.709611 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452afd0-9e1a-4e80-aaf7-f48c5c36350c service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:48.709881 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452afd0-9e1a-4e80-aaf7-f48c5c36350c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:48.717870 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452afd0-9e1a-4e80-aaf7-f48c5c36350c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:48.719465 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452afd0-9e1a-4e80-aaf7-f48c5c36350c service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:48.728182 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1324/2623] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:50:50.116019 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021f7d4-65a5-42eb-98c4-05eb3b42f69d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:50.116537 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021f7d4-65a5-42eb-98c4-05eb3b42f69d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:50.116700 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021f7d4-65a5-42eb-98c4-05eb3b42f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:50.141787 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-c021f7d4-65a5-42eb-98c4-05eb3b42f69d None None] MFA Rules not processed for user `f037681adf2f4d5a8585e3a8820534ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:50.143794 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c021f7d4-65a5-42eb-98c4-05eb3b42f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:50.155031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1300/2624] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:50:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:52.878357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860e6fa-c3a4-4e84-8ccd-a26474759449 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:52.879085 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860e6fa-c3a4-4e84-8ccd-a26474759449 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:52.879085 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860e6fa-c3a4-4e84-8ccd-a26474759449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:52.897618 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5860e6fa-c3a4-4e84-8ccd-a26474759449 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:52.898835 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5860e6fa-c3a4-4e84-8ccd-a26474759449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:52.962251 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1325/2625] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:50:53.013572 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021f7d4-65a5-42eb-98c4-05eb3b42f69d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:53.015066 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-c021f7d4-65a5-42eb-98c4-05eb3b42f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:53.087577 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021f7d4-65a5-42eb-98c4-05eb3b42f69d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:53.092542 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62bf2d-bcb8-4a24-8323-480402aa12f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:53.093242 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62bf2d-bcb8-4a24-8323-480402aa12f1 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:53.093596 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62bf2d-bcb8-4a24-8323-480402aa12f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:53.093873 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62bf2d-bcb8-4a24-8323-480402aa12f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:53.102645 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62bf2d-bcb8-4a24-8323-480402aa12f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:53.104272 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62bf2d-bcb8-4a24-8323-480402aa12f1 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:53.112154 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1301/2626] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:50:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:50:54.190219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860e6fa-c3a4-4e84-8ccd-a26474759449 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:54.208551 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860e6fa-c3a4-4e84-8ccd-a26474759449 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:54.223711 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866536b-9ac3-4ad6-8049-9149eb2520d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:54.224675 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866536b-9ac3-4ad6-8049-9149eb2520d8 service nova] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:54.227277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866536b-9ac3-4ad6-8049-9149eb2520d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:54.227749 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866536b-9ac3-4ad6-8049-9149eb2520d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:54.232196 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4866536b-9ac3-4ad6-8049-9149eb2520d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:54.262121 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866536b-9ac3-4ad6-8049-9149eb2520d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:54.264943 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866536b-9ac3-4ad6-8049-9149eb2520d8 service nova] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:54.279682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1326/2627] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:54.626888 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62bf2d-bcb8-4a24-8323-480402aa12f1 service swift] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:54.647843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62bf2d-bcb8-4a24-8323-480402aa12f1 service swift] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:54.664410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d11d338bf2c4521bdfddc5d5c8da899', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:54.668300 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:54.669809 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:54.670535 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:54.676392 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:54.708025 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:54.713684 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:54.747489 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1302/2628] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:51:10.279341 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918804e-2a56-45a9-89ab-21184ff13cb7 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:10.279851 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918804e-2a56-45a9-89ab-21184ff13cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:10.279950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918804e-2a56-45a9-89ab-21184ff13cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:10.297344 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-5918804e-2a56-45a9-89ab-21184ff13cb7 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:10.298530 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-5918804e-2a56-45a9-89ab-21184ff13cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:10.307518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1327/2629] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:10.321320 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:10.332655 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f74e0-cd39-46ff-8649-4d62fd1f8f8b service nova] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:10.337633 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef9f66-79cb-45f7-97ba-12ab77d85a00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:10.338281 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9f66-79cb-45f7-97ba-12ab77d85a00 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:10.338561 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9f66-79cb-45f7-97ba-12ab77d85a00 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:10.338835 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef9f66-79cb-45f7-97ba-12ab77d85a00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:10.346988 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef9f66-79cb-45f7-97ba-12ab77d85a00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:10.348585 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef9f66-79cb-45f7-97ba-12ab77d85a00 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:10.356770 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1303/2630] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:51:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:51:25.975886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5febcf-c690-449b-a30a-fe89fa28c567 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:25.976391 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5febcf-c690-449b-a30a-fe89fa28c567 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:25.976493 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5febcf-c690-449b-a30a-fe89fa28c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:25.994184 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-be5febcf-c690-449b-a30a-fe89fa28c567 None None] MFA Rules not processed for user `09a9cf0f43624be493e7092f3a4a8f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:25.995419 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-be5febcf-c690-449b-a30a-fe89fa28c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:26.002440 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1328/2631] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 16:51:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:26.015295 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef9f66-79cb-45f7-97ba-12ab77d85a00 service swift] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:26.025694 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef9f66-79cb-45f7-97ba-12ab77d85a00 service swift] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:26.030560 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5551a6e71bb0499d9161e6213acc0af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:26.031225 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:26.031504 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:26.031803 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:26.040262 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:26.041839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:26.050526 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1304/2632] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 16:51:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:52:12.411200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5febcf-c690-449b-a30a-fe89fa28c567 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:12.420479 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5febcf-c690-449b-a30a-fe89fa28c567 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:12.424698 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:12.425340 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:12.425622 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:12.425898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:12.427935 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:12.440208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:12.441647 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:12.451579 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1329/2633] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:15.821157 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:15.822801 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:15.837847 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500825f-ca7f-4a45-963d-1c446db635b7 service swift] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:15.842267 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:15.843163 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:15.843441 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:15.843716 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] PATH_INFO: `/v3/users/48a7478e69d740e89da1201c954cbfe0` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:15.844896 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a7478e69d740e89da1201c954cbfe0)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:15.847453 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:15.891557 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a7478e69d740e89da1201c954cbfe0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:15.898739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a7478e69d740e89da1201c954cbfe0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:15.905419 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a7478e69d740e89da1201c954cbfe0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:15.906026 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a7478e69d740e89da1201c954cbfe0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:15.921354 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-af76b40c-3500-48dd-950a-579db683f674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a7478e69d740e89da1201c954cbfe0'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:15.927487 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1305/2634] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:52:15 2022] DELETE /identity/v3/users/48a7478e69d740e89da1201c954cbfe0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:16.172869 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:16.188495 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc214-0b86-41e3-b768-316a0a32fbfb service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:16.252508 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:16.253398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.253676 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.253951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] PATH_INFO: `/v3/projects/3dbc7e862c11480e96d2804301e9796b` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.255193 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbc7e862c11480e96d2804301e9796b)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:16.257093 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:16.306889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbc7e862c11480e96d2804301e9796b', 'request_id': 'req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:16.317291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbc7e862c11480e96d2804301e9796b', 'request_id': 'req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:16.334512 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbc7e862c11480e96d2804301e9796b', 'request_id': 'req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:16.349728 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] The token cache is being invalidate because project 3dbc7e862c11480e96d2804301e9796b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:52:16.350160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:16.350930 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-3a6bd274-abc0-4aaa-bd3d-fceaf3fd61bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:16.353207 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1330/2635] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:52:16 2022] DELETE /identity/v3/projects/3dbc7e862c11480e96d2804301e9796b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:16.357743 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dfc2d-a315-4459-9203-e5378466104c None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.358031 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dfc2d-a315-4459-9203-e5378466104c None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.358310 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dfc2d-a315-4459-9203-e5378466104c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.383604 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-912dfc2d-a315-4459-9203-e5378466104c None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:16.384972 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-912dfc2d-a315-4459-9203-e5378466104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:16.446169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1306/2636] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:16.453933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a917efc-d77e-4690-aebc-1f62115be00a None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.454478 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a917efc-d77e-4690-aebc-1f62115be00a None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.455582 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a917efc-d77e-4690-aebc-1f62115be00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.476377 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-3a917efc-d77e-4690-aebc-1f62115be00a None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:16.477682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-3a917efc-d77e-4690-aebc-1f62115be00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:16.485909 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1331/2637] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:16.490688 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dfc2d-a315-4459-9203-e5378466104c None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:16.500565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dfc2d-a315-4459-9203-e5378466104c None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:16.506133 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:16.506795 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.507103 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.507374 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.508102 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:52:16.508405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:16.510000 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:16.521558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1307/2638] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:52:16.525801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a917efc-d77e-4690-aebc-1f62115be00a None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:16.535429 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a917efc-d77e-4690-aebc-1f62115be00a None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:16.540282 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbbbba-be40-4251-a287-c79efacde184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:16.541209 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbbbba-be40-4251-a287-c79efacde184 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.541572 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbbbba-be40-4251-a287-c79efacde184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.541952 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbbbba-be40-4251-a287-c79efacde184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.543701 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbbbba-be40-4251-a287-c79efacde184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:16.544899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbbbba-be40-4251-a287-c79efacde184 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:16.583928 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1332/2639] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:52:16 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:52:16.585073 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:16.595033 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543abe9-b20e-42cb-857b-2ff8d959bfd1 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:16.650774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0e7f6-4c19-4185-98de-3823edcd8d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:16.651493 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e7f6-4c19-4185-98de-3823edcd8d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.651777 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e7f6-4c19-4185-98de-3823edcd8d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.652079 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e7f6-4c19-4185-98de-3823edcd8d0d admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.652818 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0e7f6-4c19-4185-98de-3823edcd8d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:16.654791 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0e7f6-4c19-4185-98de-3823edcd8d0d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:16.678797 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1308/2640] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:52:16 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:52:16.680050 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbbbba-be40-4251-a287-c79efacde184 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:16.690769 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbbbba-be40-4251-a287-c79efacde184 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:16.695421 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c41b92-5f7d-4fbd-b24f-e524df7c7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:16.695950 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c41b92-5f7d-4fbd-b24f-e524df7c7138 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.696227 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c41b92-5f7d-4fbd-b24f-e524df7c7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.696497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c41b92-5f7d-4fbd-b24f-e524df7c7138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.697216 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c41b92-5f7d-4fbd-b24f-e524df7c7138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:16.698791 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c41b92-5f7d-4fbd-b24f-e524df7c7138 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:16.708598 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1333/2641] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:16.712428 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0e7f6-4c19-4185-98de-3823edcd8d0d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:16.722238 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0e7f6-4c19-4185-98de-3823edcd8d0d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:16.726840 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa120f-e069-4727-8373-cb89caf80b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:16.727521 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa120f-e069-4727-8373-cb89caf80b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.727798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa120f-e069-4727-8373-cb89caf80b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.728068 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa120f-e069-4727-8373-cb89caf80b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.728798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa120f-e069-4727-8373-cb89caf80b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:16.730415 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa120f-e069-4727-8373-cb89caf80b70 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:16.740918 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1309/2642] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:16.744842 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c41b92-5f7d-4fbd-b24f-e524df7c7138 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:16.755160 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c41b92-5f7d-4fbd-b24f-e524df7c7138 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:16.760325 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a9866-3383-4704-a02b-245b389732d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:16.761206 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a9866-3383-4704-a02b-245b389732d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.761489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a9866-3383-4704-a02b-245b389732d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.761766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a9866-3383-4704-a02b-245b389732d1 admin admin] PATH_INFO: `/v3/projects/d3ba88864dc14e99a2301910ba61f712/users/f1747aeacf9f4886a0be84798181f3a3/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.776420 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a9866-3383-4704-a02b-245b389732d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ba88864dc14e99a2301910ba61f712, user_id=f1747aeacf9f4886a0be84798181f3a3, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:16.779133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a9866-3383-4704-a02b-245b389732d1 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:16.791814 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1334/2643] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:16 2022] PUT /identity/v3/projects/d3ba88864dc14e99a2301910ba61f712/users/f1747aeacf9f4886a0be84798181f3a3/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:16.804104 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef23f-d4f5-49fb-b44c-5ee8a7ed066d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.804394 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef23f-d4f5-49fb-b44c-5ee8a7ed066d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.804668 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef23f-d4f5-49fb-b44c-5ee8a7ed066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.831533 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-898ef23f-d4f5-49fb-b44c-5ee8a7ed066d None None] MFA Rules not processed for user `f1747aeacf9f4886a0be84798181f3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:16.832817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-898ef23f-d4f5-49fb-b44c-5ee8a7ed066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:16.899121 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1310/2644] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:16.901620 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a9866-3383-4704-a02b-245b389732d1 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:16.962048 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a9866-3383-4704-a02b-245b389732d1 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:16.966674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be66e7b-da85-4b0d-aa7d-9235fac44a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:16.967357 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66e7b-da85-4b0d-aa7d-9235fac44a63 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:16.967642 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66e7b-da85-4b0d-aa7d-9235fac44a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:16.967918 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be66e7b-da85-4b0d-aa7d-9235fac44a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:16.968604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be66e7b-da85-4b0d-aa7d-9235fac44a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:16.971024 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be66e7b-da85-4b0d-aa7d-9235fac44a63 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:16.997079 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1335/2645] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:52:16 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:52:17.001089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef23f-d4f5-49fb-b44c-5ee8a7ed066d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:17.011897 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef23f-d4f5-49fb-b44c-5ee8a7ed066d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:17.065439 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171b80f-cb15-485c-99a9-eaa02daa8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:17.066090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b80f-cb15-485c-99a9-eaa02daa8434 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.066369 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b80f-cb15-485c-99a9-eaa02daa8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.066639 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171b80f-cb15-485c-99a9-eaa02daa8434 admin admin] PATH_INFO: `/v3/users` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.067360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171b80f-cb15-485c-99a9-eaa02daa8434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:17.069261 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171b80f-cb15-485c-99a9-eaa02daa8434 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:17.088798 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1311/2646] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:52:17 2022] POST /identity/v3/users => generated 309 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:52:17.092718 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be66e7b-da85-4b0d-aa7d-9235fac44a63 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:17.103370 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be66e7b-da85-4b0d-aa7d-9235fac44a63 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:17.107944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e290d-fbe9-41a0-9586-cf71ecc40012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:17.108600 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e290d-fbe9-41a0-9586-cf71ecc40012 admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.108877 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e290d-fbe9-41a0-9586-cf71ecc40012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.109150 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e290d-fbe9-41a0-9586-cf71ecc40012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.109859 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e290d-fbe9-41a0-9586-cf71ecc40012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:17.112122 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e290d-fbe9-41a0-9586-cf71ecc40012 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:17.122400 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1336/2647] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:17.126342 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171b80f-cb15-485c-99a9-eaa02daa8434 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:17.135992 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171b80f-cb15-485c-99a9-eaa02daa8434 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:17.140459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79105daa-900d-4749-b999-daaf1a15b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:17.141318 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79105daa-900d-4749-b999-daaf1a15b53f admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.141597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79105daa-900d-4749-b999-daaf1a15b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.141874 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79105daa-900d-4749-b999-daaf1a15b53f admin admin] PATH_INFO: `/v3/projects/27b61f37cdcd4a7eaa51ebeda4f4ebbd/users/12650853fe5b44a4b224a80eb33db37b/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.156379 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79105daa-900d-4749-b999-daaf1a15b53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b61f37cdcd4a7eaa51ebeda4f4ebbd, user_id=12650853fe5b44a4b224a80eb33db37b, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:17.159951 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79105daa-900d-4749-b999-daaf1a15b53f admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:17.172334 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1312/2648] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:17 2022] PUT /identity/v3/projects/27b61f37cdcd4a7eaa51ebeda4f4ebbd/users/12650853fe5b44a4b224a80eb33db37b/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:52:17.177174 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e290d-fbe9-41a0-9586-cf71ecc40012 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:17.187296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e290d-fbe9-41a0-9586-cf71ecc40012 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:17.240942 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e9975-8f73-4504-8cf4-3bb8d130f61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:17.241602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9975-8f73-4504-8cf4-3bb8d130f61a admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.241885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9975-8f73-4504-8cf4-3bb8d130f61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.242163 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9975-8f73-4504-8cf4-3bb8d130f61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.242882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e9975-8f73-4504-8cf4-3bb8d130f61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:17.244503 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e9975-8f73-4504-8cf4-3bb8d130f61a admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:17.253785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1337/2649] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:17.257843 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79105daa-900d-4749-b999-daaf1a15b53f admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:17.268373 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79105daa-900d-4749-b999-daaf1a15b53f admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:17.272998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:17.273858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.274134 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.274405 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] PATH_INFO: `/v3/projects/27b61f37cdcd4a7eaa51ebeda4f4ebbd/users/12650853fe5b44a4b224a80eb33db37b/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.276372 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b61f37cdcd4a7eaa51ebeda4f4ebbd, user_id=12650853fe5b44a4b224a80eb33db37b, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:17.279137 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:17.289459 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1313/2650] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:17 2022] PUT /identity/v3/projects/27b61f37cdcd4a7eaa51ebeda4f4ebbd/users/12650853fe5b44a4b224a80eb33db37b/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:52:17.299280 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d262-da01-4e8a-b713-3b7b57867a9e None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.299578 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d262-da01-4e8a-b713-3b7b57867a9e None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.299886 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d262-da01-4e8a-b713-3b7b57867a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.326139 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-b178d262-da01-4e8a-b713-3b7b57867a9e None None] MFA Rules not processed for user `12650853fe5b44a4b224a80eb33db37b`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:17.327458 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-b178d262-da01-4e8a-b713-3b7b57867a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:17.392888 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1338/2651] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:17.403358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:17.405052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:17.463432 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6be2b-72e2-4c40-bff5-43a5153cf04c admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:17.468194 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f32b3-70aa-4360-af54-bd458e84421f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:17.469018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f32b3-70aa-4360-af54-bd458e84421f service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.469400 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f32b3-70aa-4360-af54-bd458e84421f service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.469741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f32b3-70aa-4360-af54-bd458e84421f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.481544 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f32b3-70aa-4360-af54-bd458e84421f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:17.483063 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f32b3-70aa-4360-af54-bd458e84421f service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:17.493890 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1314/2652] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:17.638885 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d262-da01-4e8a-b713-3b7b57867a9e None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:17.700374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d262-da01-4e8a-b713-3b7b57867a9e None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:17.704862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:17.705721 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.705998 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.706434 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] PATH_INFO: `/v3/users/f1747aeacf9f4886a0be84798181f3a3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.707604 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1747aeacf9f4886a0be84798181f3a3)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:17.709506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:17.755358 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1747aeacf9f4886a0be84798181f3a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:17.762099 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1747aeacf9f4886a0be84798181f3a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:17.769190 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1747aeacf9f4886a0be84798181f3a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:17.770072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1747aeacf9f4886a0be84798181f3a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:17.781596 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1747aeacf9f4886a0be84798181f3a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:17.787901 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1339/2653] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:52:17 2022] DELETE /identity/v3/users/f1747aeacf9f4886a0be84798181f3a3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:17.792404 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41511f-8cc5-45b9-b3af-784e6d375f27 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.792697 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41511f-8cc5-45b9-b3af-784e6d375f27 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.792979 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41511f-8cc5-45b9-b3af-784e6d375f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.811576 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-fb41511f-8cc5-45b9-b3af-784e6d375f27 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:17.812774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fb41511f-8cc5-45b9-b3af-784e6d375f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:17.881566 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1315/2654] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:17.890378 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:17.891849 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:17.947314 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf284e3-70d3-46a7-81c0-eb692cb9065f admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:17.950860 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14c22-8b93-4cd9-95f1-9ee0985c737d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:17.951522 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14c22-8b93-4cd9-95f1-9ee0985c737d service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:17.951801 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14c22-8b93-4cd9-95f1-9ee0985c737d service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:17.952072 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14c22-8b93-4cd9-95f1-9ee0985c737d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:17.961889 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b14c22-8b93-4cd9-95f1-9ee0985c737d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:17.963350 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b14c22-8b93-4cd9-95f1-9ee0985c737d service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:17.973180 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1340/2655] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:18.236942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41511f-8cc5-45b9-b3af-784e6d375f27 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:18.239197 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-fb41511f-8cc5-45b9-b3af-784e6d375f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:18.252879 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41511f-8cc5-45b9-b3af-784e6d375f27 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:18.258001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:18.258858 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:18.259177 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:18.259451 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] PATH_INFO: `/v3/projects/d3ba88864dc14e99a2301910ba61f712` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:18.260714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ba88864dc14e99a2301910ba61f712)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:18.262582 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:18.311899 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ba88864dc14e99a2301910ba61f712', 'request_id': 'req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.319467 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ba88864dc14e99a2301910ba61f712', 'request_id': 'req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.324793 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ba88864dc14e99a2301910ba61f712', 'request_id': 'req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.336052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] The token cache is being invalidate because project d3ba88864dc14e99a2301910ba61f712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:52:18.336341 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.336964 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.338497 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1316/2656] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:52:18 2022] DELETE /identity/v3/projects/d3ba88864dc14e99a2301910ba61f712 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:18.342496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14c22-8b93-4cd9-95f1-9ee0985c737d service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:18.351753 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14c22-8b93-4cd9-95f1-9ee0985c737d service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:18.404286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:18.405136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:18.405415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:18.405688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] PATH_INFO: `/v3/users/12650853fe5b44a4b224a80eb33db37b` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:18.406919 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12650853fe5b44a4b224a80eb33db37b)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:18.408758 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:18.452306 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12650853fe5b44a4b224a80eb33db37b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.459273 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12650853fe5b44a4b224a80eb33db37b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.466183 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12650853fe5b44a4b224a80eb33db37b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.466742 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12650853fe5b44a4b224a80eb33db37b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.477815 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-c04b9846-922c-4c4c-8398-58d4873c9381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12650853fe5b44a4b224a80eb33db37b'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.483660 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1341/2657] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:52:18 2022] DELETE /identity/v3/users/12650853fe5b44a4b224a80eb33db37b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:18.743518 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:18.744960 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:18.758529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1437c-9e68-4d2a-bb6c-a09c621da8fd admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:18.812895 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:18.813753 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:18.814034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:18.814304 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] PATH_INFO: `/v3/projects/27b61f37cdcd4a7eaa51ebeda4f4ebbd` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:18.815509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b61f37cdcd4a7eaa51ebeda4f4ebbd)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:18.818052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:18.862126 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b61f37cdcd4a7eaa51ebeda4f4ebbd', 'request_id': 'req-297520c2-f796-4173-90d1-ea1cff9acf33'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.869486 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b61f37cdcd4a7eaa51ebeda4f4ebbd', 'request_id': 'req-297520c2-f796-4173-90d1-ea1cff9acf33'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.874779 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b61f37cdcd4a7eaa51ebeda4f4ebbd', 'request_id': 'req-297520c2-f796-4173-90d1-ea1cff9acf33'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.886305 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] The token cache is being invalidate because project 27b61f37cdcd4a7eaa51ebeda4f4ebbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:52:18.886870 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.887259 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-297520c2-f796-4173-90d1-ea1cff9acf33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:18.888816 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1317/2658] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:52:18 2022] DELETE /identity/v3/projects/27b61f37cdcd4a7eaa51ebeda4f4ebbd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:18.894012 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19b31-1b94-4a73-a1ba-037bea179b96 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:18.894296 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19b31-1b94-4a73-a1ba-037bea179b96 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:18.894594 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19b31-1b94-4a73-a1ba-037bea179b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:18.911764 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-9ba19b31-1b94-4a73-a1ba-037bea179b96 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:18.912974 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9ba19b31-1b94-4a73-a1ba-037bea179b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:18.970255 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1342/2659] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:18.979095 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcb2fd-216f-4112-ae5b-d6560115be93 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:18.979384 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcb2fd-216f-4112-ae5b-d6560115be93 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:18.979658 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcb2fd-216f-4112-ae5b-d6560115be93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:18.998090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-66dcb2fd-216f-4112-ae5b-d6560115be93 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:18.999377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-66dcb2fd-216f-4112-ae5b-d6560115be93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:19.008092 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1318/2660] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:19.012013 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19b31-1b94-4a73-a1ba-037bea179b96 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.021413 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19b31-1b94-4a73-a1ba-037bea179b96 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.025858 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.026496 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.026840 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.027063 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.027779 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:52:19.028082 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.029641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.041046 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1343/2661] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:52:19.045090 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcb2fd-216f-4112-ae5b-d6560115be93 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.055146 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcb2fd-216f-4112-ae5b-d6560115be93 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.059747 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706bded-c9e3-4dbb-b1ef-8f5b27c82e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.060390 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bded-c9e3-4dbb-b1ef-8f5b27c82e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.060669 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bded-c9e3-4dbb-b1ef-8f5b27c82e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.060942 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706bded-c9e3-4dbb-b1ef-8f5b27c82e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.061632 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706bded-c9e3-4dbb-b1ef-8f5b27c82e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.063556 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706bded-c9e3-4dbb-b1ef-8f5b27c82e4b admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.088853 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1319/2662] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:52:19 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:52:19.092283 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.102277 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73bd4d-377f-4e44-abf7-7731b51c385f admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.155427 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b756c-1fd2-4abb-9f89-21fcac50766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.156083 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b756c-1fd2-4abb-9f89-21fcac50766e admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.156368 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b756c-1fd2-4abb-9f89-21fcac50766e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.156645 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b756c-1fd2-4abb-9f89-21fcac50766e admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.157333 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b756c-1fd2-4abb-9f89-21fcac50766e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.159244 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b756c-1fd2-4abb-9f89-21fcac50766e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.178826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1344/2663] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:52:19 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:52:19.182791 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706bded-c9e3-4dbb-b1ef-8f5b27c82e4b admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.192851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706bded-c9e3-4dbb-b1ef-8f5b27c82e4b admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.197412 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cd51c-4167-45fd-b09c-4706e6f0059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.198057 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd51c-4167-45fd-b09c-4706e6f0059d admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.198335 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd51c-4167-45fd-b09c-4706e6f0059d admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.198634 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd51c-4167-45fd-b09c-4706e6f0059d admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.199389 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cd51c-4167-45fd-b09c-4706e6f0059d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.201086 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cd51c-4167-45fd-b09c-4706e6f0059d admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.211112 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1320/2664] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:19.214878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b756c-1fd2-4abb-9f89-21fcac50766e admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.225098 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b756c-1fd2-4abb-9f89-21fcac50766e admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.229649 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d325c9-f620-440c-b1a0-02b30e12405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.230295 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d325c9-f620-440c-b1a0-02b30e12405e admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.230580 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d325c9-f620-440c-b1a0-02b30e12405e admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.230857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d325c9-f620-440c-b1a0-02b30e12405e admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.231610 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d325c9-f620-440c-b1a0-02b30e12405e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.233180 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d325c9-f620-440c-b1a0-02b30e12405e admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.243472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1345/2665] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:19.247507 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cd51c-4167-45fd-b09c-4706e6f0059d admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.257333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cd51c-4167-45fd-b09c-4706e6f0059d admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.261817 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9479ca-ce92-423b-8d8e-115458583282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.262936 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9479ca-ce92-423b-8d8e-115458583282 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.263240 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9479ca-ce92-423b-8d8e-115458583282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.263512 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9479ca-ce92-423b-8d8e-115458583282 admin admin] PATH_INFO: `/v3/projects/bc024bfa769f45d988faf2f9ee2dd0fb/users/ef5a74512fc8444ab00c6e900c3c09ec/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.277511 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9479ca-ce92-423b-8d8e-115458583282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc024bfa769f45d988faf2f9ee2dd0fb, user_id=ef5a74512fc8444ab00c6e900c3c09ec, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.280169 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9479ca-ce92-423b-8d8e-115458583282 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.293446 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1321/2666] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:19 2022] PUT /identity/v3/projects/bc024bfa769f45d988faf2f9ee2dd0fb/users/ef5a74512fc8444ab00c6e900c3c09ec/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:19.304693 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595911-9a4f-4888-aee8-0bef3c6e6fa5 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.304989 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595911-9a4f-4888-aee8-0bef3c6e6fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.305269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595911-9a4f-4888-aee8-0bef3c6e6fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.331278 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f1595911-9a4f-4888-aee8-0bef3c6e6fa5 None None] MFA Rules not processed for user `ef5a74512fc8444ab00c6e900c3c09ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:19.332472 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f1595911-9a4f-4888-aee8-0bef3c6e6fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:19.393430 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1346/2667] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:19.397832 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9479ca-ce92-423b-8d8e-115458583282 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.457366 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9479ca-ce92-423b-8d8e-115458583282 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.462041 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9766-d337-492c-81a0-8fe6e9d29df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.462690 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9766-d337-492c-81a0-8fe6e9d29df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.463059 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9766-d337-492c-81a0-8fe6e9d29df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.463276 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9766-d337-492c-81a0-8fe6e9d29df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.463970 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9766-d337-492c-81a0-8fe6e9d29df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.465857 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9766-d337-492c-81a0-8fe6e9d29df0 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.489653 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1322/2668] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:52:19 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:52:19.493766 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1595911-9a4f-4888-aee8-0bef3c6e6fa5 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.504238 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1595911-9a4f-4888-aee8-0bef3c6e6fa5 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.558922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe56c82-5032-4772-8f1e-f4c7766c7914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.559545 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56c82-5032-4772-8f1e-f4c7766c7914 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.559826 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56c82-5032-4772-8f1e-f4c7766c7914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.560101 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56c82-5032-4772-8f1e-f4c7766c7914 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.560802 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe56c82-5032-4772-8f1e-f4c7766c7914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.562699 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe56c82-5032-4772-8f1e-f4c7766c7914 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.581750 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1347/2669] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:52:19 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:52:19.585822 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9766-d337-492c-81a0-8fe6e9d29df0 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.595723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9766-d337-492c-81a0-8fe6e9d29df0 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.600796 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d443fb-675d-4044-a0d0-2a599f3876d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.601440 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d443fb-675d-4044-a0d0-2a599f3876d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.601723 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d443fb-675d-4044-a0d0-2a599f3876d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.601997 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d443fb-675d-4044-a0d0-2a599f3876d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.602718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d443fb-675d-4044-a0d0-2a599f3876d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.604332 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d443fb-675d-4044-a0d0-2a599f3876d4 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.614393 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1323/2670] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:19.618232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe56c82-5032-4772-8f1e-f4c7766c7914 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.627810 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe56c82-5032-4772-8f1e-f4c7766c7914 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.632532 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d67fd0-11a2-4f8d-b412-e76ec2d5dbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.633428 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d67fd0-11a2-4f8d-b412-e76ec2d5dbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.633707 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d67fd0-11a2-4f8d-b412-e76ec2d5dbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.633979 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d67fd0-11a2-4f8d-b412-e76ec2d5dbfa admin admin] PATH_INFO: `/v3/projects/562fae7a93404df6b6fbbc1b00dcb9cf/users/235b89c787cc4a38bfc5b25a01e755a3/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.648630 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d67fd0-11a2-4f8d-b412-e76ec2d5dbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=562fae7a93404df6b6fbbc1b00dcb9cf, user_id=235b89c787cc4a38bfc5b25a01e755a3, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.651291 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d67fd0-11a2-4f8d-b412-e76ec2d5dbfa admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.663759 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1348/2671] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:19 2022] PUT /identity/v3/projects/562fae7a93404df6b6fbbc1b00dcb9cf/users/235b89c787cc4a38bfc5b25a01e755a3/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:19.667611 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d443fb-675d-4044-a0d0-2a599f3876d4 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.677654 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d443fb-675d-4044-a0d0-2a599f3876d4 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.734999 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dd6df-f23a-4a84-997a-c16193537c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.735665 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dd6df-f23a-4a84-997a-c16193537c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.735950 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dd6df-f23a-4a84-997a-c16193537c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.736226 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dd6df-f23a-4a84-997a-c16193537c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.736953 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dd6df-f23a-4a84-997a-c16193537c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.738614 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dd6df-f23a-4a84-997a-c16193537c2a admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.748018 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1324/2672] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:19.753518 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d67fd0-11a2-4f8d-b412-e76ec2d5dbfa admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.763607 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d67fd0-11a2-4f8d-b412-e76ec2d5dbfa admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.768317 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.769717 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.770006 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.770286 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] PATH_INFO: `/v3/projects/562fae7a93404df6b6fbbc1b00dcb9cf/users/235b89c787cc4a38bfc5b25a01e755a3/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.772289 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=562fae7a93404df6b6fbbc1b00dcb9cf, user_id=235b89c787cc4a38bfc5b25a01e755a3, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.774916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.785406 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1349/2673] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:19 2022] PUT /identity/v3/projects/562fae7a93404df6b6fbbc1b00dcb9cf/users/235b89c787cc4a38bfc5b25a01e755a3/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:19.795314 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a3f8-aea5-4059-b581-e38b9610e5f1 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.795603 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a3f8-aea5-4059-b581-e38b9610e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.795880 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a3f8-aea5-4059-b581-e38b9610e5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.822923 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-f6f3a3f8-aea5-4059-b581-e38b9610e5f1 None None] MFA Rules not processed for user `235b89c787cc4a38bfc5b25a01e755a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:19.824088 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f6f3a3f8-aea5-4059-b581-e38b9610e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:19.898141 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1325/2674] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:19.909682 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:19.911392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:19.965615 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b6cee-524f-4f92-b7ce-48ae24ad9aed admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:19.969136 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b908e74-127c-49de-adf3-b0c0e694e01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:19.969785 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b908e74-127c-49de-adf3-b0c0e694e01b service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:19.970065 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b908e74-127c-49de-adf3-b0c0e694e01b service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:19.970334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b908e74-127c-49de-adf3-b0c0e694e01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:19.978899 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b908e74-127c-49de-adf3-b0c0e694e01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:19.980334 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b908e74-127c-49de-adf3-b0c0e694e01b service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:19.989408 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1350/2675] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:20.032862 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a3f8-aea5-4059-b581-e38b9610e5f1 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:20.034233 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f6f3a3f8-aea5-4059-b581-e38b9610e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:20.046036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a3f8-aea5-4059-b581-e38b9610e5f1 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:20.049573 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750ec35-5a23-4360-aa2d-aa4405e7ae68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:20.050232 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750ec35-5a23-4360-aa2d-aa4405e7ae68 service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:20.050509 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750ec35-5a23-4360-aa2d-aa4405e7ae68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:20.050782 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750ec35-5a23-4360-aa2d-aa4405e7ae68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:20.104616 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750ec35-5a23-4360-aa2d-aa4405e7ae68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:20.105998 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750ec35-5a23-4360-aa2d-aa4405e7ae68 service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:20.114565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1326/2676] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:23.496019 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b908e74-127c-49de-adf3-b0c0e694e01b service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:23.556316 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b908e74-127c-49de-adf3-b0c0e694e01b service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:23.560783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:23.561641 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:23.561920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:23.562195 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] PATH_INFO: `/v3/users/ef5a74512fc8444ab00c6e900c3c09ec` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:23.563398 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5a74512fc8444ab00c6e900c3c09ec)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:23.565301 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:23.608224 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5a74512fc8444ab00c6e900c3c09ec'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:23.617080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5a74512fc8444ab00c6e900c3c09ec'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:23.625287 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5a74512fc8444ab00c6e900c3c09ec'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:23.625882 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5a74512fc8444ab00c6e900c3c09ec'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:23.637188 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5a74512fc8444ab00c6e900c3c09ec'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:23.642843 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1351/2677] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:52:23 2022] DELETE /identity/v3/users/ef5a74512fc8444ab00c6e900c3c09ec => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:23.647266 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e197a-2af2-420d-bbab-a2bc0e560d84 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:23.647741 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e197a-2af2-420d-bbab-a2bc0e560d84 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:23.647869 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e197a-2af2-420d-bbab-a2bc0e560d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:23.664742 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-395e197a-2af2-420d-bbab-a2bc0e560d84 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:23.665907 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-395e197a-2af2-420d-bbab-a2bc0e560d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:23.720974 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1327/2678] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:23.731084 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:23.732459 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:23.788041 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d30b62-dcc8-45be-bce5-91caf1f0b685 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:23.791920 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6219a-482b-43c8-95eb-d114768e1fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:23.792566 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6219a-482b-43c8-95eb-d114768e1fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:23.792852 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6219a-482b-43c8-95eb-d114768e1fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:23.793133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6219a-482b-43c8-95eb-d114768e1fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:23.803170 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6219a-482b-43c8-95eb-d114768e1fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:23.804602 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6219a-482b-43c8-95eb-d114768e1fa2 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:23.814166 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1352/2679] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:24.070343 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e197a-2af2-420d-bbab-a2bc0e560d84 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:24.071790 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-395e197a-2af2-420d-bbab-a2bc0e560d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:24.084045 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e197a-2af2-420d-bbab-a2bc0e560d84 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:24.088685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:24.089548 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:24.089826 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:24.090224 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] PATH_INFO: `/v3/projects/bc024bfa769f45d988faf2f9ee2dd0fb` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:24.091431 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc024bfa769f45d988faf2f9ee2dd0fb)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:24.093337 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:24.137491 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc024bfa769f45d988faf2f9ee2dd0fb', 'request_id': 'req-060bae5c-d99b-4be1-85b1-e8c453101b0c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.145223 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc024bfa769f45d988faf2f9ee2dd0fb', 'request_id': 'req-060bae5c-d99b-4be1-85b1-e8c453101b0c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.150558 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc024bfa769f45d988faf2f9ee2dd0fb', 'request_id': 'req-060bae5c-d99b-4be1-85b1-e8c453101b0c'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.161704 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] The token cache is being invalidate because project bc024bfa769f45d988faf2f9ee2dd0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:52:24.161985 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.162597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.164132 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1328/2680] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:52:24 2022] DELETE /identity/v3/projects/bc024bfa769f45d988faf2f9ee2dd0fb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:24.168133 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6219a-482b-43c8-95eb-d114768e1fa2 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:24.177595 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6219a-482b-43c8-95eb-d114768e1fa2 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:24.231528 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:24.232390 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:24.232665 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:24.232932 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] PATH_INFO: `/v3/users/235b89c787cc4a38bfc5b25a01e755a3` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:24.234096 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235b89c787cc4a38bfc5b25a01e755a3)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:24.236036 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:24.280106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235b89c787cc4a38bfc5b25a01e755a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.287177 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235b89c787cc4a38bfc5b25a01e755a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.294081 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235b89c787cc4a38bfc5b25a01e755a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.294697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235b89c787cc4a38bfc5b25a01e755a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.305944 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.notifications [None req-ce72edca-26c5-4d15-99dc-07700c8892b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235b89c787cc4a38bfc5b25a01e755a3'} {{(pid=81322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.311922 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1353/2681] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 16:52:24 2022] DELETE /identity/v3/users/235b89c787cc4a38bfc5b25a01e755a3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:52:24.567642 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:24.569040 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:24.582395 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bae5c-d99b-4be1-85b1-e8c453101b0c admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:24.638475 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:24.639358 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:24.639635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:24.639903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] PATH_INFO: `/v3/projects/562fae7a93404df6b6fbbc1b00dcb9cf` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:24.641089 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562fae7a93404df6b6fbbc1b00dcb9cf)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:24.643001 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:24.686659 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562fae7a93404df6b6fbbc1b00dcb9cf', 'request_id': 'req-6a4d1e1d-f17b-4189-87c4-d67b920659f6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.693838 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562fae7a93404df6b6fbbc1b00dcb9cf', 'request_id': 'req-6a4d1e1d-f17b-4189-87c4-d67b920659f6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.698989 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562fae7a93404df6b6fbbc1b00dcb9cf', 'request_id': 'req-6a4d1e1d-f17b-4189-87c4-d67b920659f6'} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.709274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] The token cache is being invalidate because project 562fae7a93404df6b6fbbc1b00dcb9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:52:24.709565 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.710179 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.notifications [None req-6a4d1e1d-f17b-4189-87c4-d67b920659f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:52:24.711738 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1329/2682] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 16:52:24 2022] DELETE /identity/v3/projects/562fae7a93404df6b6fbbc1b00dcb9cf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:24.716712 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587b940-99a0-4a18-955c-1e5ad68217c4 None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:24.717219 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587b940-99a0-4a18-955c-1e5ad68217c4 None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:24.717328 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587b940-99a0-4a18-955c-1e5ad68217c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:24.735225 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-f587b940-99a0-4a18-955c-1e5ad68217c4 None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:24.736415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-f587b940-99a0-4a18-955c-1e5ad68217c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:24.792688 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1354/2683] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:24.801739 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846efc54-142a-4ee1-b12c-fcff0edc732d None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:24.802274 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846efc54-142a-4ee1-b12c-fcff0edc732d None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:24.802549 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846efc54-142a-4ee1-b12c-fcff0edc732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:24.820941 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-846efc54-142a-4ee1-b12c-fcff0edc732d None None] MFA Rules not processed for user `0464ce0cc2c244588f440cfed98f23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:24.822136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-846efc54-142a-4ee1-b12c-fcff0edc732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:24.830564 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1330/2684] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:24.835230 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587b940-99a0-4a18-955c-1e5ad68217c4 None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:24.844669 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587b940-99a0-4a18-955c-1e5ad68217c4 None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:24.849137 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:24.849780 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:24.850310 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:24.850588 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:24.851392 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:52:24.851697 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:24.853269 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:24.864924 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1355/2685] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 16:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:52:24.869036 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846efc54-142a-4ee1-b12c-fcff0edc732d None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:24.878767 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846efc54-142a-4ee1-b12c-fcff0edc732d None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:24.883680 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aa27a-8cf0-4bb2-ab2b-6b9a30da2d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:24.884333 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aa27a-8cf0-4bb2-ab2b-6b9a30da2d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:24.884610 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aa27a-8cf0-4bb2-ab2b-6b9a30da2d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:24.884884 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aa27a-8cf0-4bb2-ab2b-6b9a30da2d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:24.885567 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aa27a-8cf0-4bb2-ab2b-6b9a30da2d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:24.887538 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aa27a-8cf0-4bb2-ab2b-6b9a30da2d22 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:24.912210 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1331/2686] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:52:24 2022] POST /identity/v3/projects => generated 409 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:52:24.916367 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:24.927155 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dcdeb-e3db-49cc-8e9e-49657dbe89fb admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:24.979497 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ceb4-841c-43d4-828f-ad79706a9907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:24.980147 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ceb4-841c-43d4-828f-ad79706a9907 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:24.980431 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ceb4-841c-43d4-828f-ad79706a9907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:24.980704 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ceb4-841c-43d4-828f-ad79706a9907 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:24.981387 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0ceb4-841c-43d4-828f-ad79706a9907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:24.983300 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0ceb4-841c-43d4-828f-ad79706a9907 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.003912 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1356/2687] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:52:24 2022] POST /identity/v3/users => generated 305 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:52:25.007903 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aa27a-8cf0-4bb2-ab2b-6b9a30da2d22 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.017996 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aa27a-8cf0-4bb2-ab2b-6b9a30da2d22 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.022924 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13559-e2ae-4956-84e4-76c469b9062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.023597 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13559-e2ae-4956-84e4-76c469b9062b admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.023877 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13559-e2ae-4956-84e4-76c469b9062b admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.024150 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13559-e2ae-4956-84e4-76c469b9062b admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.024867 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13559-e2ae-4956-84e4-76c469b9062b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.026648 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13559-e2ae-4956-84e4-76c469b9062b admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.037108 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1332/2688] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:25.040987 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ceb4-841c-43d4-828f-ad79706a9907 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.051213 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0ceb4-841c-43d4-828f-ad79706a9907 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.055993 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d72a0-2d73-4297-92a7-8622baee71eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.056637 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d72a0-2d73-4297-92a7-8622baee71eb admin admin] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.056916 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d72a0-2d73-4297-92a7-8622baee71eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.057185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d72a0-2d73-4297-92a7-8622baee71eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.057898 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d72a0-2d73-4297-92a7-8622baee71eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.059489 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d72a0-2d73-4297-92a7-8622baee71eb admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.069674 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1357/2689] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:25.073529 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13559-e2ae-4956-84e4-76c469b9062b admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.083113 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13559-e2ae-4956-84e4-76c469b9062b admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.087910 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cba319-fcaf-439a-a054-1a884aab8038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.088774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba319-fcaf-439a-a054-1a884aab8038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.089052 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba319-fcaf-439a-a054-1a884aab8038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.089323 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba319-fcaf-439a-a054-1a884aab8038 admin admin] PATH_INFO: `/v3/projects/053d985043cb4d9e9d341dc9ceca5822/users/79870812907b49a3863813120ba0d120/roles/6ec804c74dad4bf8847c06a34d95505a` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.104055 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cba319-fcaf-439a-a054-1a884aab8038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053d985043cb4d9e9d341dc9ceca5822, user_id=79870812907b49a3863813120ba0d120, role_id=6ec804c74dad4bf8847c06a34d95505a)` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.106664 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cba319-fcaf-439a-a054-1a884aab8038 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.119866 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1333/2690] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:25 2022] PUT /identity/v3/projects/053d985043cb4d9e9d341dc9ceca5822/users/79870812907b49a3863813120ba0d120/roles/6ec804c74dad4bf8847c06a34d95505a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:25.130332 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354cc08-ca62-4b99-b125-ec14cb6c41fb None None] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.130621 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354cc08-ca62-4b99-b125-ec14cb6c41fb None None] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.130897 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354cc08-ca62-4b99-b125-ec14cb6c41fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.156092 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.auth.core [None req-9354cc08-ca62-4b99-b125-ec14cb6c41fb None None] MFA Rules not processed for user `79870812907b49a3863813120ba0d120`. Rule list: `[]` (Enabled: `True`). {{(pid=81322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:25.157268 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-9354cc08-ca62-4b99-b125-ec14cb6c41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:25.216878 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1358/2691] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:25.221269 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cba319-fcaf-439a-a054-1a884aab8038 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.278808 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cba319-fcaf-439a-a054-1a884aab8038 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.283377 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5547f-c824-4e4a-b69f-d800c8036052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.284013 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5547f-c824-4e4a-b69f-d800c8036052 admin admin] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.284783 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5547f-c824-4e4a-b69f-d800c8036052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.285053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5547f-c824-4e4a-b69f-d800c8036052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.285728 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5547f-c824-4e4a-b69f-d800c8036052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.287714 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5547f-c824-4e4a-b69f-d800c8036052 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.312505 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1334/2692] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 16:52:25 2022] POST /identity/v3/projects => generated 407 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:52:25.316399 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354cc08-ca62-4b99-b125-ec14cb6c41fb None None] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.326862 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354cc08-ca62-4b99-b125-ec14cb6c41fb None None] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.380200 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f02f5a-167e-4259-b5bb-9f1a33d88246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.380857 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02f5a-167e-4259-b5bb-9f1a33d88246 admin admin] REQUEST_METHOD: `POST` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.381139 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02f5a-167e-4259-b5bb-9f1a33d88246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.381415 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f02f5a-167e-4259-b5bb-9f1a33d88246 admin admin] PATH_INFO: `/v3/users` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.382104 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f02f5a-167e-4259-b5bb-9f1a33d88246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.384039 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f02f5a-167e-4259-b5bb-9f1a33d88246 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.402786 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1359/2693] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 16:52:25 2022] POST /identity/v3/users => generated 310 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:52:25.406892 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5547f-c824-4e4a-b69f-d800c8036052 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.417427 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5547f-c824-4e4a-b69f-d800c8036052 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.422067 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03618-b8d0-44ed-8ce4-5eac6773a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.422721 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03618-b8d0-44ed-8ce4-5eac6773a5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.423034 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03618-b8d0-44ed-8ce4-5eac6773a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.423312 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03618-b8d0-44ed-8ce4-5eac6773a5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.424030 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f03618-b8d0-44ed-8ce4-5eac6773a5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.426214 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f03618-b8d0-44ed-8ce4-5eac6773a5c4 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.436769 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1335/2694] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:25.440659 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f02f5a-167e-4259-b5bb-9f1a33d88246 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.450106 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f02f5a-167e-4259-b5bb-9f1a33d88246 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.454614 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc5514-2512-450a-abdf-c858cf978256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.455506 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc5514-2512-450a-abdf-c858cf978256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.455783 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc5514-2512-450a-abdf-c858cf978256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.456559 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc5514-2512-450a-abdf-c858cf978256 admin admin] PATH_INFO: `/v3/projects/e559fdfe2c774c7a8904fff67240e9ff/users/71da01bc315840c0b63d2095fc214b95/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.470262 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc5514-2512-450a-abdf-c858cf978256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e559fdfe2c774c7a8904fff67240e9ff, user_id=71da01bc315840c0b63d2095fc214b95, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.473522 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc5514-2512-450a-abdf-c858cf978256 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.486080 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1360/2695] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:25 2022] PUT /identity/v3/projects/e559fdfe2c774c7a8904fff67240e9ff/users/71da01bc315840c0b63d2095fc214b95/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:52:25.490122 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03618-b8d0-44ed-8ce4-5eac6773a5c4 admin admin] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.499934 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03618-b8d0-44ed-8ce4-5eac6773a5c4 admin admin] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.556028 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e38a28-a6e8-481d-8571-0836805e0233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.556685 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e38a28-a6e8-481d-8571-0836805e0233 admin admin] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.556966 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e38a28-a6e8-481d-8571-0836805e0233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.557248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e38a28-a6e8-481d-8571-0836805e0233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.557966 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e38a28-a6e8-481d-8571-0836805e0233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.559595 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e38a28-a6e8-481d-8571-0836805e0233 admin admin] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.568851 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1336/2696] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:52:25.572988 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc5514-2512-450a-abdf-c858cf978256 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.583389 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc5514-2512-450a-abdf-c858cf978256 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.587892 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0464ce0cc2c244588f440cfed98f23ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f2ab0bb70f249b18504d9e6616306cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.588754 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.589034 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.589307 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] PATH_INFO: `/v3/projects/e559fdfe2c774c7a8904fff67240e9ff/users/71da01bc315840c0b63d2095fc214b95/roles/90029ab98d9d4f11bd1b3f77fad73c84` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.591250 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e559fdfe2c774c7a8904fff67240e9ff, user_id=71da01bc315840c0b63d2095fc214b95, role_id=90029ab98d9d4f11bd1b3f77fad73c84)` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.593833 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.604199 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1361/2697] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 16:52:25 2022] PUT /identity/v3/projects/e559fdfe2c774c7a8904fff67240e9ff/users/71da01bc315840c0b63d2095fc214b95/roles/90029ab98d9d4f11bd1b3f77fad73c84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:52:25.615187 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cecb-4f12-4589-b10f-988f575f3908 None None] REQUEST_METHOD: `POST` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.615479 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cecb-4f12-4589-b10f-988f575f3908 None None] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.615762 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cecb-4f12-4589-b10f-988f575f3908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.640990 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.auth.core [None req-f5d8cecb-4f12-4589-b10f-988f575f3908 None None] MFA Rules not processed for user `71da01bc315840c0b63d2095fc214b95`. Rule list: `[]` (Enabled: `True`). {{(pid=81323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:25.642182 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-f5d8cecb-4f12-4589-b10f-988f575f3908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:25.707735 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1337/2698] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 16:52:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:25.718380 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.720130 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:25.775536 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef74e5-84d2-4202-b908-a4ca025fd9d4 admin admin] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.779178 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.779807 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.780090 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.780366 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:25.789735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:25.791185 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:25.800374 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1362/2699] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:25 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:25.944955 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8cecb-4f12-4589-b10f-988f575f3908 None None] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:25.954360 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8cecb-4f12-4589-b10f-988f575f3908 None None] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:25.958637 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c789864ed513471fb6b367aecf236828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:25.959350 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:25.959635 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:25.959909 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:26.013410 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:26.014839 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:26.024096 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1338/2700] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:27.510657 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:52:27.512315 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:27.568457 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c7211-250b-487e-9263-de860ff5681d service cinder] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:52:27.571933 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:52:27.572735 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:27.573116 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:27.573411 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:27.575232 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:27.631445 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:52:27.632876 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:52:27.641628 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1363/2701] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:52:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:11.741325 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] Authenticating user token {{(pid=81323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:11.742718 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:11.810248 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854a7dd-2d74-42f9-965f-0fdcd916479f service cinder] Validating token access rules against request {{(pid=81323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:11.815136 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a12444-da8f-4960-9789-7df60a610cba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63ed36df893640fc929d7953751d1116', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:11.815774 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12444-da8f-4960-9789-7df60a610cba service placement] REQUEST_METHOD: `GET` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:11.816053 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12444-da8f-4960-9789-7df60a610cba service placement] SCRIPT_NAME: `/identity` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:11.816328 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a12444-da8f-4960-9789-7df60a610cba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:11.818063 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.fernet_utils [None req-e4a12444-da8f-4960-9789-7df60a610cba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:11.829020 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a12444-da8f-4960-9789-7df60a610cba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:11.830622 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a12444-da8f-4960-9789-7df60a610cba service placement] RBAC: Authorization granted {{(pid=81323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:11.840403 dv-cinder-841302-1-iscsi devstack@keystone.service[81323]: [pid: 81323|app: 0|req: 1339/2702] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:54:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:14.449001 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] Authenticating user token {{(pid=81322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:14.457625 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b120c2-ac6e-4df6-8219-78f63614c412 service neutron] Validating token access rules against request {{(pid=81322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:14.461208 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d356f-52c5-45a3-a16d-c58c21394e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b1227b7f36498e8c1f1e27fa0ccb46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c3d9e5ea5b45f98e7c48a87e60905e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:14.461841 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d356f-52c5-45a3-a16d-c58c21394e5b service neutron] REQUEST_METHOD: `GET` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:14.462123 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d356f-52c5-45a3-a16d-c58c21394e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:14.462397 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d356f-52c5-45a3-a16d-c58c21394e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:14.464159 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.fernet_utils [None req-542d356f-52c5-45a3-a16d-c58c21394e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:14.473856 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d356f-52c5-45a3-a16d-c58c21394e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:14.475302 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d356f-52c5-45a3-a16d-c58c21394e5b service neutron] RBAC: Authorization granted {{(pid=81322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:14.482951 dv-cinder-841302-1-iscsi devstack@keystone.service[81322]: [pid: 81322|app: 0|req: 1364/2703] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 16:56:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)